Max level shown:
12024-11-19T02:15:02.768ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 085f8488-3ef3-429f-93b9-d6856cb48db0 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
22024-11-19T02:15:02.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 085f8488-3ef3-429f-93b9-d6856cb48db0 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
32024-11-19T02:15:02.770ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2548 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 085f8488-3ef3-429f-93b9-d6856cb48db0 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
42024-11-19T02:15:03.792ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 69466c68-a163-407c-9b7e-fbf087a82553 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
52024-11-19T02:15:03.792ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 69466c68-a163-407c-9b7e-fbf087a82553 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
62024-11-19T02:15:03.794ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2717 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 69466c68-a163-407c-9b7e-fbf087a82553 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
72024-11-19T02:15:04.816ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 7f3708eb-f2ee-422a-8c3d-6af2445a6dbb roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
82024-11-19T02:15:04.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 7f3708eb-f2ee-422a-8c3d-6af2445a6dbb resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
92024-11-19T02:15:04.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2200 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 7f3708eb-f2ee-422a-8c3d-6af2445a6dbb response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
102024-11-19T02:15:05.723ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
112024-11-19T02:15:05.723ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
122024-11-19T02:15:05.723ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
132024-11-19T02:15:05.723ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
142024-11-19T02:15:05.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
152024-11-19T02:15:05.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
162024-11-19T02:15:05.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
172024-11-19T02:15:05.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
182024-11-19T02:15:05.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
192024-11-19T02:15:05.727ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.555122ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
202024-11-19T02:15:05.728ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
212024-11-19T02:15:05.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
222024-11-19T02:15:05.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
232024-11-19T02:15:05.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
242024-11-19T02:15:05.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
252024-11-19T02:15:05.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
262024-11-19T02:15:05.737ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
272024-11-19T02:15:05.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
282024-11-19T02:15:05.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
292024-11-19T02:15:05.749ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
302024-11-19T02:15:05.749ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.726375ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
312024-11-19T02:15:05.838ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = bd271767-d137-4658-99df-555ac1745cb3 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
322024-11-19T02:15:05.838ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = bd271767-d137-4658-99df-555ac1745cb3 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
332024-11-19T02:15:05.840ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1653 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = bd271767-d137-4658-99df-555ac1745cb3 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
342024-11-19T02:15:06.860ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 2dfb16e3-1b0c-4b5f-9a10-378ddd07dbcc roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
352024-11-19T02:15:06.861ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 2dfb16e3-1b0c-4b5f-9a10-378ddd07dbcc resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
362024-11-19T02:15:06.862ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1748 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 2dfb16e3-1b0c-4b5f-9a10-378ddd07dbcc response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
372024-11-19T02:15:07.152ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1252 local_addr = [fd00:1122:3344:101::c]:60807 method = GET remote_addr = [fd00:1122:3344:101::d]:57844 req_id = 831edd74-aabd-4251-821f-e73b34f74270 response_code = 200 uri = /9f0b435f-0000-451e-9dbc-dcec71543c30
382024-11-19T02:15:07.883ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6bafcec2-b6fc-4f2a-907e-b774a3668f05 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
392024-11-19T02:15:07.883ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6bafcec2-b6fc-4f2a-907e-b774a3668f05 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
402024-11-19T02:15:07.885ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2018 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6bafcec2-b6fc-4f2a-907e-b774a3668f05 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
412024-11-19T02:15:08.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c81fbc7b-0dde-4de6-81fd-2637f7cc29ae roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
422024-11-19T02:15:08.905ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c81fbc7b-0dde-4de6-81fd-2637f7cc29ae resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
432024-11-19T02:15:08.907ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2154 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c81fbc7b-0dde-4de6-81fd-2637f7cc29ae response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
442024-11-19T02:15:09.925ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 2e624310-4183-4b32-a426-5624676a8f78 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
452024-11-19T02:15:09.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 2e624310-4183-4b32-a426-5624676a8f78 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
462024-11-19T02:15:09.927ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2118 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 2e624310-4183-4b32-a426-5624676a8f78 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
472024-11-19T02:15:10.948ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 06b11780-b61c-412e-a336-694b201da9fa roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
482024-11-19T02:15:10.948ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 06b11780-b61c-412e-a336-694b201da9fa resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
492024-11-19T02:15:10.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1804 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 06b11780-b61c-412e-a336-694b201da9fa response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
502024-11-19T02:15:11.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 8835b9cd-5956-4c8b-9013-bf8683cc763e roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
512024-11-19T02:15:11.971ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 8835b9cd-5956-4c8b-9013-bf8683cc763e resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
522024-11-19T02:15:11.973ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2777 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 8835b9cd-5956-4c8b-9013-bf8683cc763e response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
532024-11-19T02:15:12.995ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 322635b3-ec3d-4bc6-b21b-a2489d3d513c roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
542024-11-19T02:15:12.995ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 322635b3-ec3d-4bc6-b21b-a2489d3d513c resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
552024-11-19T02:15:12.997ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2254 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 322635b3-ec3d-4bc6-b21b-a2489d3d513c response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
562024-11-19T02:15:14.019ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 95d20325-4b9e-4b37-964c-4192cdf826f6 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
572024-11-19T02:15:14.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 95d20325-4b9e-4b37-964c-4192cdf826f6 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
582024-11-19T02:15:14.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2633 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 95d20325-4b9e-4b37-964c-4192cdf826f6 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
592024-11-19T02:15:15.042ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d6671cf4-991a-4ce4-b2a0-8bdc78b5ec26 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
602024-11-19T02:15:15.043ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d6671cf4-991a-4ce4-b2a0-8bdc78b5ec26 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
612024-11-19T02:15:15.044ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2184 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d6671cf4-991a-4ce4-b2a0-8bdc78b5ec26 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
622024-11-19T02:15:15.723ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
632024-11-19T02:15:15.723ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
642024-11-19T02:15:15.723ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
652024-11-19T02:15:15.723ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
662024-11-19T02:15:15.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
672024-11-19T02:15:15.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
682024-11-19T02:15:15.723ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
692024-11-19T02:15:15.723ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
702024-11-19T02:15:15.723ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
712024-11-19T02:15:15.723ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
722024-11-19T02:15:15.723ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
732024-11-19T02:15:15.723ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
742024-11-19T02:15:15.723ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
752024-11-19T02:15:15.723ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
762024-11-19T02:15:15.723ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
772024-11-19T02:15:15.723ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
782024-11-19T02:15:15.723ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
792024-11-19T02:15:15.723ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
802024-11-19T02:15:15.723ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
812024-11-19T02:15:15.723ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
822024-11-19T02:15:15.723ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
832024-11-19T02:15:15.723ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
842024-11-19T02:15:15.723ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
852024-11-19T02:15:15.723ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
862024-11-19T02:15:15.723ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
872024-11-19T02:15:15.723ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
882024-11-19T02:15:15.723ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
892024-11-19T02:15:15.723ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
902024-11-19T02:15:15.723ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
912024-11-19T02:15:15.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
922024-11-19T02:15:15.723ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
932024-11-19T02:15:15.723ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
942024-11-19T02:15:15.723ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
952024-11-19T02:15:15.723ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
962024-11-19T02:15:15.723ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
972024-11-19T02:15:15.723ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
982024-11-19T02:15:15.723ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
992024-11-19T02:15:15.724ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1002024-11-19T02:15:15.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
1012024-11-19T02:15:15.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1022024-11-19T02:15:15.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1032024-11-19T02:15:15.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1042024-11-19T02:15:15.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1052024-11-19T02:15:15.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1062024-11-19T02:15:15.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1072024-11-19T02:15:15.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
1082024-11-19T02:15:15.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1092024-11-19T02:15:15.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1102024-11-19T02:15:15.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1112024-11-19T02:15:15.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1122024-11-19T02:15:15.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1132024-11-19T02:15:15.726ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1213, tv_nsec: 512704890 } })
1142024-11-19T02:15:15.726ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1213, tv_nsec: 512863942 } })
1152024-11-19T02:15:15.726ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
1162024-11-19T02:15:15.726ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
1172024-11-19T02:15:15.727ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.49831ms iteration = 12 status = {"errors":[],"records_set_to_done":[]}
1182024-11-19T02:15:15.728ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1192024-11-19T02:15:15.728ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1202024-11-19T02:15:15.729ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.097208ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
1212024-11-19T02:15:15.729ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1222024-11-19T02:15:15.731ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
1232024-11-19T02:15:15.731ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1242024-11-19T02:15:15.731ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1252024-11-19T02:15:15.731ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1262024-11-19T02:15:15.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1272024-11-19T02:15:15.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1282024-11-19T02:15:15.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
1292024-11-19T02:15:15.732ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1302024-11-19T02:15:15.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1312024-11-19T02:15:15.733ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1322024-11-19T02:15:15.734ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1332024-11-19T02:15:15.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
1342024-11-19T02:15:15.735ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1352024-11-19T02:15:15.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1362024-11-19T02:15:15.736ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1372024-11-19T02:15:15.736ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1382024-11-19T02:15:15.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1392024-11-19T02:15:15.738ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1402024-11-19T02:15:15.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1412024-11-19T02:15:15.739ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1422024-11-19T02:15:15.739ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1432024-11-19T02:15:15.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1442024-11-19T02:15:15.739ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1213, tv_nsec: 526123593 } })
1452024-11-19T02:15:15.740ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
1462024-11-19T02:15:15.741ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1472024-11-19T02:15:15.741ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1482024-11-19T02:15:15.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1492024-11-19T02:15:15.764ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1502024-11-19T02:15:15.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1512024-11-19T02:15:15.767ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1522024-11-19T02:15:15.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1532024-11-19T02:15:15.767ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1542024-11-19T02:15:15.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
1552024-11-19T02:15:15.769ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1562024-11-19T02:15:15.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1572024-11-19T02:15:15.770ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1582024-11-19T02:15:15.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1592024-11-19T02:15:15.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1602024-11-19T02:15:15.772ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1612024-11-19T02:15:15.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1622024-11-19T02:15:15.773ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
1632024-11-19T02:15:15.773ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1642024-11-19T02:15:15.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1652024-11-19T02:15:15.773ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 49.577648ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
1662024-11-19T02:15:15.773ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1672024-11-19T02:15:15.773ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
1682024-11-19T02:15:15.773ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1692024-11-19T02:15:15.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1702024-11-19T02:15:15.776ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
1712024-11-19T02:15:15.776ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 52.292719ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
1722024-11-19T02:15:15.778ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1732024-11-19T02:15:15.781ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1742024-11-19T02:15:15.781ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1752024-11-19T02:15:15.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1762024-11-19T02:15:15.799ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
1772024-11-19T02:15:15.799ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1782024-11-19T02:15:15.800ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "97d028c6-b071-444d-acde-1d04b2415cab", "content-length": "26", "date": "Tue, 19 Nov 2024 02:15:15 GMT"} })
1792024-11-19T02:15:15.800ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1802024-11-19T02:15:15.800ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
1812024-11-19T02:15:15.800ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1822024-11-19T02:15:15.800ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dcc0d758-ee87-4a23-84bf-2cf63c2b0695", "content-length": "26", "date": "Tue, 19 Nov 2024 02:15:15 GMT"} })
1832024-11-19T02:15:15.800ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1842024-11-19T02:15:15.801ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1852024-11-19T02:15:15.803ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
1862024-11-19T02:15:15.803ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
1872024-11-19T02:15:15.804ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: ffe74824-0c08-48e1-a755-fb123e8dc181, lookup_type: ById(ffe74824-0c08-48e1-a755-fb123e8dc181) } result = Ok(())
1882024-11-19T02:15:15.804ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1892024-11-19T02:15:15.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1902024-11-19T02:15:15.839ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1912024-11-19T02:15:15.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1922024-11-19T02:15:15.840ZINFOnexus (BackgroundTasks): VPC route manager sled ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
1932024-11-19T02:15:15.840ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
1942024-11-19T02:15:15.840ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c618632c-6c22-445e-9f15-362c2411f3af", "content-length": "372", "date": "Tue, 19 Nov 2024 02:15:15 GMT"} })
1952024-11-19T02:15:15.840ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1962024-11-19T02:15:15.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1972024-11-19T02:15:15.841ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 zone_address = fd00:1122:3344:101::2
1982024-11-19T02:15:15.841ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1992024-11-19T02:15:15.841ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8d24b18c-b88d-4b2f-b4f4-0cabd8acb034", "content-length": "26", "date": "Tue, 19 Nov 2024 02:15:15 GMT"} })
2002024-11-19T02:15:15.841ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2012024-11-19T02:15:15.843ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
2022024-11-19T02:15:15.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2032024-11-19T02:15:15.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2042024-11-19T02:15:15.845ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 121.325278ms iteration = 12 status = 0
2052024-11-19T02:15:15.883ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2062024-11-19T02:15:15.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2072024-11-19T02:15:15.884ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2082024-11-19T02:15:15.884ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
2092024-11-19T02:15:15.884ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2102024-11-19T02:15:15.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2112024-11-19T02:15:15.886ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 162.368418ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
2122024-11-19T02:15:15.886ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 163.008817ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
2132024-11-19T02:15:15.887ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 163.583543ms iteration = 12 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
2142024-11-19T02:15:15.899ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
2152024-11-19T02:15:15.900ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "a4d0e7f7-5768-4c12-b143-77177b0ceb24", "content-length": "1", "date": "Tue, 19 Nov 2024 02:15:15 GMT"} })
2162024-11-19T02:15:15.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2172024-11-19T02:15:15.901ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
2182024-11-19T02:15:15.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
2192024-11-19T02:15:15.903ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
2202024-11-19T02:15:15.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2212024-11-19T02:15:15.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2222024-11-19T02:15:15.903ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 180.453016ms iteration = 12 status = null
2232024-11-19T02:15:15.906ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 183.221417ms iteration = 12 status = {}
2242024-11-19T02:15:15.907ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
2252024-11-19T02:15:15.907ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
2262024-11-19T02:15:15.907ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "cb5772dc-63eb-403a-aac7-8c1db1172870", "date": "Tue, 19 Nov 2024 02:15:15 GMT"} })
2272024-11-19T02:15:15.907ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2282024-11-19T02:15:15.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2292024-11-19T02:15:15.911ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2302024-11-19T02:15:15.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2312024-11-19T02:15:15.918ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2322024-11-19T02:15:15.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2332024-11-19T02:15:15.918ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
2342024-11-19T02:15:15.918ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 194.947672ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
2352024-11-19T02:15:15.927ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 203.687202ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
2362024-11-19T02:15:15.931ZINFOnexus (BackgroundTasks): VPC route manager sled ffe74824-0c08-48e1-a755-fb123e8dc181 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
2372024-11-19T02:15:15.931ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
2382024-11-19T02:15:15.931ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e5135bca-c347-4332-a6c8-e4eb090227c3", "date": "Tue, 19 Nov 2024 02:15:15 GMT"} })
2392024-11-19T02:15:15.933ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2402024-11-19T02:15:15.933ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
2412024-11-19T02:15:15.933ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 209.976923ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
2422024-11-19T02:15:15.933ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 210.183026ms iteration = 13 status = {}
2432024-11-19T02:15:15.965ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 241.641586ms iteration = 15 status = {"physical_disks_added":0}
2442024-11-19T02:15:15.980ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2452024-11-19T02:15:15.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2462024-11-19T02:15:15.982ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2472024-11-19T02:15:15.984ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
2482024-11-19T02:15:15.984ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2492024-11-19T02:15:15.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2502024-11-19T02:15:16.009ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2512024-11-19T02:15:16.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2522024-11-19T02:15:16.011ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 20bc3881-e2ee-4d8d-b84b-b0c1e478721f, rack_id: a894e92e-d765-4f15-b6b7-cb9ca46d1860, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8597d802-6d4d-4493-88de-333a1f340c20) } rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0
2532024-11-19T02:15:16.011ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2542024-11-19T02:15:16.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2552024-11-19T02:15:16.027ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2562024-11-19T02:15:16.028ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
2572024-11-19T02:15:16.029ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "93f7584d-2768-45f9-9ce0-476289760cc2", "content-length": "134", "date": "Tue, 19 Nov 2024 02:15:15 GMT"} })
2582024-11-19T02:15:16.029ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
2592024-11-19T02:15:16.029ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8597d802-6d4d-4493-88de-333a1f340c20
2602024-11-19T02:15:16.029ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
2612024-11-19T02:15:16.029ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2622024-11-19T02:15:16.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2632024-11-19T02:15:16.029ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
2642024-11-19T02:15:16.029ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
2652024-11-19T02:15:16.029ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2662024-11-19T02:15:16.029ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2672024-11-19T02:15:16.029ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2682024-11-19T02:15:16.029ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
2692024-11-19T02:15:16.029ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2702024-11-19T02:15:16.029ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
2712024-11-19T02:15:16.030ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
2722024-11-19T02:15:16.030ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2732024-11-19T02:15:16.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2742024-11-19T02:15:16.032ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
2752024-11-19T02:15:16.032ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "522c5a20-7920-4a83-b1e7-d808b9b89c56", "content-length": "2", "date": "Tue, 19 Nov 2024 02:15:15 GMT"} })
2762024-11-19T02:15:16.032ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
2772024-11-19T02:15:16.032ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "8c0ea3ca-20c2-4ded-a081-5dea02f60554", "content-length": "52", "date": "Tue, 19 Nov 2024 02:15:15 GMT"} })
2782024-11-19T02:15:16.032ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0
2792024-11-19T02:15:16.032ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
2802024-11-19T02:15:16.166ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
2812024-11-19T02:15:16.169ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e2aca412-e49b-4ee0-a615-ed9168901f2a", "date": "Tue, 19 Nov 2024 02:15:15 GMT"} })
2822024-11-19T02:15:16.169ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch = Switch0
2832024-11-19T02:15:16.169ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
2842024-11-19T02:15:16.169ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d0e1322a-032d-46d1-b8a1-cd63aaa3082c roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
2852024-11-19T02:15:16.169ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "92b8b7e8-0f76-45dd-9539-b67e88546efb", "content-length": "682", "date": "Tue, 19 Nov 2024 02:15:16 GMT"} })
2862024-11-19T02:15:16.169ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2872024-11-19T02:15:16.169ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d0e1322a-032d-46d1-b8a1-cd63aaa3082c resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
2882024-11-19T02:15:16.169ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "fefacd01-8e19-4550-ace0-ebcb7061ed23", "content-length": "691", "date": "Tue, 19 Nov 2024 02:15:16 GMT"} })
2892024-11-19T02:15:16.170ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
2902024-11-19T02:15:16.170ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
2912024-11-19T02:15:16.170ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
2922024-11-19T02:15:16.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2932024-11-19T02:15:16.171ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2474 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d0e1322a-032d-46d1-b8a1-cd63aaa3082c response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
2942024-11-19T02:15:16.172ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 448.17689ms iteration = 12 status = {}
2952024-11-19T02:15:16.173ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2962024-11-19T02:15:16.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2972024-11-19T02:15:16.177ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2982024-11-19T02:15:16.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2992024-11-19T02:15:16.180ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3002024-11-19T02:15:16.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3012024-11-19T02:15:16.188ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 464.419765ms iteration = 12 status = {}
3022024-11-19T02:15:16.665ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = cb7ae104-0c0b-4a99-b5fa-1261183bfdac roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
3032024-11-19T02:15:16.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = cb7ae104-0c0b-4a99-b5fa-1261183bfdac resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
3042024-11-19T02:15:16.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3266 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = cb7ae104-0c0b-4a99-b5fa-1261183bfdac response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
3052024-11-19T02:15:17.193ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0d85ae9f-b2cc-456e-b5fd-707573c99d43 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
3062024-11-19T02:15:17.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0d85ae9f-b2cc-456e-b5fd-707573c99d43 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
3072024-11-19T02:15:17.195ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2389 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0d85ae9f-b2cc-456e-b5fd-707573c99d43 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
3082024-11-19T02:15:18.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 033c8b90-133a-424c-8677-6740de00a6a0 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
3092024-11-19T02:15:18.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 033c8b90-133a-424c-8677-6740de00a6a0 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
3102024-11-19T02:15:18.217ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2173 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 033c8b90-133a-424c-8677-6740de00a6a0 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
3112024-11-19T02:15:19.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b0916333-d8c5-422a-bd42-7371df7a86be roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
3122024-11-19T02:15:19.238ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b0916333-d8c5-422a-bd42-7371df7a86be resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
3132024-11-19T02:15:19.240ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2604 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b0916333-d8c5-422a-bd42-7371df7a86be response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
3142024-11-19T02:15:20.261ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6305184a-837d-4ac5-9122-a24de333920e roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
3152024-11-19T02:15:20.261ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6305184a-837d-4ac5-9122-a24de333920e resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
3162024-11-19T02:15:20.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2323 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6305184a-837d-4ac5-9122-a24de333920e response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
3172024-11-19T02:15:21.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 561bd016-b09f-4583-a32d-5840276027db roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
3182024-11-19T02:15:21.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 561bd016-b09f-4583-a32d-5840276027db resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
3192024-11-19T02:15:21.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2151 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 561bd016-b09f-4583-a32d-5840276027db response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
3202024-11-19T02:15:22.151ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1315 local_addr = [fd00:1122:3344:101::c]:60807 method = GET remote_addr = [fd00:1122:3344:101::d]:57844 req_id = abb4dc93-2c12-43b8-bbdb-0bcdbe1fc774 response_code = 200 uri = /9f0b435f-0000-451e-9dbc-dcec71543c30
3212024-11-19T02:15:22.306ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e2e04eff-0c5d-4b85-ace1-19e5be14b2ce roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
3222024-11-19T02:15:22.307ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e2e04eff-0c5d-4b85-ace1-19e5be14b2ce resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
3232024-11-19T02:15:22.309ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2418 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e2e04eff-0c5d-4b85-ace1-19e5be14b2ce response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
3242024-11-19T02:15:23.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4169b0bf-205d-494e-aa0e-0a5533b6b6df roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
3252024-11-19T02:15:23.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4169b0bf-205d-494e-aa0e-0a5533b6b6df resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
3262024-11-19T02:15:23.332ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2458 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4169b0bf-205d-494e-aa0e-0a5533b6b6df response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
3272024-11-19T02:15:24.354ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3eb60078-bf3e-4951-ae23-a597e4dd4b70 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
3282024-11-19T02:15:24.354ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3eb60078-bf3e-4951-ae23-a597e4dd4b70 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
3292024-11-19T02:15:24.356ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2240 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3eb60078-bf3e-4951-ae23-a597e4dd4b70 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
3302024-11-19T02:15:25.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 8d93e449-faba-47c9-a4fd-b7dd1363fd10 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
3312024-11-19T02:15:25.376ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 8d93e449-faba-47c9-a4fd-b7dd1363fd10 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
3322024-11-19T02:15:25.378ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2230 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 8d93e449-faba-47c9-a4fd-b7dd1363fd10 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
3332024-11-19T02:15:25.723ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
3342024-11-19T02:15:25.723ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
3352024-11-19T02:15:25.723ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3362024-11-19T02:15:25.723ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3372024-11-19T02:15:25.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3382024-11-19T02:15:25.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3392024-11-19T02:15:25.725ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3402024-11-19T02:15:25.728ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
3412024-11-19T02:15:25.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3422024-11-19T02:15:25.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3432024-11-19T02:15:25.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3442024-11-19T02:15:25.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3452024-11-19T02:15:25.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3462024-11-19T02:15:25.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
3472024-11-19T02:15:25.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3482024-11-19T02:15:25.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3492024-11-19T02:15:25.750ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
3502024-11-19T02:15:25.750ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.793477ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
3512024-11-19T02:15:25.757ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3522024-11-19T02:15:25.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3532024-11-19T02:15:25.786ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.331545ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3542024-11-19T02:15:26.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = cb4c4cec-b6b4-4816-bbac-cc91f329a50b roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
3552024-11-19T02:15:26.398ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = cb4c4cec-b6b4-4816-bbac-cc91f329a50b resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
3562024-11-19T02:15:26.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2189 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = cb4c4cec-b6b4-4816-bbac-cc91f329a50b response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
3572024-11-19T02:15:27.422ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = dafaf33c-3284-4ce2-acab-a36bece7a807 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
3582024-11-19T02:15:27.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = dafaf33c-3284-4ce2-acab-a36bece7a807 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
3592024-11-19T02:15:27.424ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2191 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = dafaf33c-3284-4ce2-acab-a36bece7a807 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
3602024-11-19T02:15:28.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 1cbe0cd5-fd12-41ed-99c4-72882058dee9 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
3612024-11-19T02:15:28.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 1cbe0cd5-fd12-41ed-99c4-72882058dee9 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
3622024-11-19T02:15:28.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2210 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 1cbe0cd5-fd12-41ed-99c4-72882058dee9 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
3632024-11-19T02:15:29.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = eb0bfb75-dec2-4b78-99be-d9c97e630797 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
3642024-11-19T02:15:29.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = eb0bfb75-dec2-4b78-99be-d9c97e630797 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
3652024-11-19T02:15:29.471ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2435 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = eb0bfb75-dec2-4b78-99be-d9c97e630797 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
3662024-11-19T02:15:30.235ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
3672024-11-19T02:15:30.235ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
3682024-11-19T02:15:30.265ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
3692024-11-19T02:15:30.265ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:54154
3702024-11-19T02:15:30.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:54154 req_id = 2156b18d-3863-4558-8ec5-cd65af21ef89 roles = RoleSet { roles: {} } uri = /metrics/producers
3712024-11-19T02:15:30.265ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:54154 req_id = 2156b18d-3863-4558-8ec5-cd65af21ef89 resource = Database result = Ok(()) uri = /metrics/producers
3722024-11-19T02:15:30.306ZINFOnexus: assigned collector to new producer collector_id = 3980dd20-a3be-40d3-b9e5-094b8ed4b785 file = nexus/src/app/oximeter.rs:76 producer_id = 9f0b435f-0000-451e-9dbc-dcec71543c30
3732024-11-19T02:15:30.306ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40922 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:54154 req_id = 2156b18d-3863-4558-8ec5-cd65af21ef89 response_code = 201 uri = /metrics/producers
3742024-11-19T02:15:30.306ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "2156b18d-3863-4558-8ec5-cd65af21ef89", "content-length": "41", "date": "Tue, 19 Nov 2024 02:15:30 GMT"} })
3752024-11-19T02:15:30.308ZDEBGnexus (producer-registration-task): registered with nexus successfully
3762024-11-19T02:15:30.308ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
3772024-11-19T02:15:30.492ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 71507ba4-3d71-410b-9bb4-229a5bcd31f8 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
3782024-11-19T02:15:30.493ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 71507ba4-3d71-410b-9bb4-229a5bcd31f8 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
3792024-11-19T02:15:30.495ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2375 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 71507ba4-3d71-410b-9bb4-229a5bcd31f8 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
3802024-11-19T02:15:31.515ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0aa5125a-61f3-4087-b668-bea258284c3d roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
3812024-11-19T02:15:31.516ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0aa5125a-61f3-4087-b668-bea258284c3d resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
3822024-11-19T02:15:31.518ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2529 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0aa5125a-61f3-4087-b668-bea258284c3d response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
3832024-11-19T02:15:32.538ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 24cd8854-151c-456e-8e4d-3f7e30a4e2d8 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
3842024-11-19T02:15:32.538ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 24cd8854-151c-456e-8e4d-3f7e30a4e2d8 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
3852024-11-19T02:15:32.540ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2163 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 24cd8854-151c-456e-8e4d-3f7e30a4e2d8 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
3862024-11-19T02:15:33.562ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0f388411-70b0-4830-b961-7e66e3508700 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
3872024-11-19T02:15:33.563ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0f388411-70b0-4830-b961-7e66e3508700 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
3882024-11-19T02:15:33.564ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2006 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0f388411-70b0-4830-b961-7e66e3508700 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
3892024-11-19T02:15:34.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 31ace186-2523-48e3-be9a-2ae81129d1e8 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
3902024-11-19T02:15:34.586ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 31ace186-2523-48e3-be9a-2ae81129d1e8 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
3912024-11-19T02:15:34.588ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2286 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 31ace186-2523-48e3-be9a-2ae81129d1e8 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
3922024-11-19T02:15:35.609ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 793ff415-e720-412e-8622-12cf583d4b27 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
3932024-11-19T02:15:35.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 793ff415-e720-412e-8622-12cf583d4b27 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
3942024-11-19T02:15:35.611ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2096 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 793ff415-e720-412e-8622-12cf583d4b27 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
3952024-11-19T02:15:35.723ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
3962024-11-19T02:15:35.723ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
3972024-11-19T02:15:35.723ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3982024-11-19T02:15:35.723ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3992024-11-19T02:15:35.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4002024-11-19T02:15:35.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4012024-11-19T02:15:35.753ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4022024-11-19T02:15:35.753ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4032024-11-19T02:15:35.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4042024-11-19T02:15:35.755ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.842825ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
4052024-11-19T02:15:35.756ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
4062024-11-19T02:15:35.756ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4072024-11-19T02:15:35.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4082024-11-19T02:15:35.758ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4092024-11-19T02:15:35.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4102024-11-19T02:15:35.791ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4112024-11-19T02:15:35.794ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
4122024-11-19T02:15:35.794ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4132024-11-19T02:15:35.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4142024-11-19T02:15:35.806ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
4152024-11-19T02:15:35.806ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 83.103521ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
4162024-11-19T02:15:36.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c19e2627-a322-4fc4-b806-bf0cc98872f2 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
4172024-11-19T02:15:36.632ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c19e2627-a322-4fc4-b806-bf0cc98872f2 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
4182024-11-19T02:15:36.634ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2552 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c19e2627-a322-4fc4-b806-bf0cc98872f2 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
4192024-11-19T02:15:37.150ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1396 local_addr = [fd00:1122:3344:101::c]:60807 method = GET remote_addr = [fd00:1122:3344:101::d]:57844 req_id = 1e4db2df-9a9e-4eb9-bfaf-b1c5e9f440f1 response_code = 200 uri = /9f0b435f-0000-451e-9dbc-dcec71543c30
4202024-11-19T02:15:37.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a928244a-c0cb-40a4-b733-27827c165e82 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
4212024-11-19T02:15:37.655ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a928244a-c0cb-40a4-b733-27827c165e82 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
4222024-11-19T02:15:37.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2030 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a928244a-c0cb-40a4-b733-27827c165e82 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
4232024-11-19T02:15:38.678ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b9479429-e8e1-42b0-9a78-1314128af92a roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
4242024-11-19T02:15:38.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b9479429-e8e1-42b0-9a78-1314128af92a resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
4252024-11-19T02:15:38.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1887 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b9479429-e8e1-42b0-9a78-1314128af92a response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
4262024-11-19T02:15:39.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9dd2db33-81d6-4092-9dd7-e29636165e71 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
4272024-11-19T02:15:39.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9dd2db33-81d6-4092-9dd7-e29636165e71 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
4282024-11-19T02:15:39.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2011 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9dd2db33-81d6-4092-9dd7-e29636165e71 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
4292024-11-19T02:15:40.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 8888e8a1-54d4-4866-8fc3-f74c56438bb0 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
4302024-11-19T02:15:40.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 8888e8a1-54d4-4866-8fc3-f74c56438bb0 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
4312024-11-19T02:15:40.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1900 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 8888e8a1-54d4-4866-8fc3-f74c56438bb0 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
4322024-11-19T02:15:41.749ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 888a98e3-91c9-453e-a82e-7c7ff9f376c1 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
4332024-11-19T02:15:41.749ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 888a98e3-91c9-453e-a82e-7c7ff9f376c1 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
4342024-11-19T02:15:41.751ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1921 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 888a98e3-91c9-453e-a82e-7c7ff9f376c1 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
4352024-11-19T02:15:42.771ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3ef3adb4-22c5-47c9-b16b-4c298203a811 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
4362024-11-19T02:15:42.771ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3ef3adb4-22c5-47c9-b16b-4c298203a811 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
4372024-11-19T02:15:42.773ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1998 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3ef3adb4-22c5-47c9-b16b-4c298203a811 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
4382024-11-19T02:15:43.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 56bab705-a98d-44d5-b96f-dbed2d24d43c roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
4392024-11-19T02:15:43.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 56bab705-a98d-44d5-b96f-dbed2d24d43c resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
4402024-11-19T02:15:43.795ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2293 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 56bab705-a98d-44d5-b96f-dbed2d24d43c response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
4412024-11-19T02:15:44.814ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 98e2257d-d3e5-429c-b29f-2a0ca80399dd roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
4422024-11-19T02:15:44.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 98e2257d-d3e5-429c-b29f-2a0ca80399dd resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
4432024-11-19T02:15:44.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2314 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 98e2257d-d3e5-429c-b29f-2a0ca80399dd response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
4442024-11-19T02:15:45.722ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
4452024-11-19T02:15:45.722ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
4462024-11-19T02:15:45.722ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
4472024-11-19T02:15:45.722ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
4482024-11-19T02:15:45.722ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-19 02:05:45.722715297 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
4492024-11-19T02:15:45.722ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
4502024-11-19T02:15:45.722ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
4512024-11-19T02:15:45.722ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4522024-11-19T02:15:45.722ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
4532024-11-19T02:15:45.722ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
4542024-11-19T02:15:45.722ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
4552024-11-19T02:15:45.722ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4562024-11-19T02:15:45.722ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
4572024-11-19T02:15:45.722ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4582024-11-19T02:15:45.722ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
4592024-11-19T02:15:45.722ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
4602024-11-19T02:15:45.722ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4612024-11-19T02:15:45.722ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
4622024-11-19T02:15:45.722ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
4632024-11-19T02:15:45.722ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
4642024-11-19T02:15:45.722ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
4652024-11-19T02:15:45.722ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115
4662024-11-19T02:15:45.722ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4672024-11-19T02:15:45.722ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.07\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115"}
4682024-11-19T02:15:45.722ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
4692024-11-19T02:15:45.722ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
4702024-11-19T02:15:45.722ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
4712024-11-19T02:15:45.722ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
4722024-11-19T02:15:45.722ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
4732024-11-19T02:15:45.722ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4742024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
4752024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4762024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
4772024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
4782024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4792024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
4802024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
4812024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
4822024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
4832024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
4842024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
4852024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
4862024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
4872024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
4882024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
4892024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
4902024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
4912024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4922024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
4932024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
4942024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
4952024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
4962024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
4972024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
4982024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
4992024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
5002024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
5012024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
5022024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
5032024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
5042024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5052024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
5062024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5072024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
5082024-11-19T02:15:45.723ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
5092024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
5102024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
5112024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5122024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5132024-11-19T02:15:45.723ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2d59cdb7-e3b1-4e94-afa3-f64f69928234.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a949a8d8-46c7-4423-b760-c03f98ccf638.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b190a9bf-d8b7-43c3-add4-e113c9b89870.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b190a9bf-d8b7-43c3-add4-e113c9b89870.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1243, tv_nsec: 510474294 } })
5142024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5152024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
5162024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5172024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
5182024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5192024-11-19T02:15:45.723ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("27d1a6ca-1b76-4956-aefa-e234c7d60cd0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("91bdcbd0-987b-49c4-8200-fc3e8f332b6b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("91bdcbd0-987b-49c4-8200-fc3e8f332b6b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1243, tv_nsec: 510654756 } })
5202024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5212024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5222024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5232024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
5242024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5252024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
5262024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5272024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
5282024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5292024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
5302024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5312024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
5322024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
5332024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5342024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
5352024-11-19T02:15:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
5362024-11-19T02:15:45.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
5372024-11-19T02:15:45.724ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
5382024-11-19T02:15:45.724ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
5392024-11-19T02:15:45.724ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.347885ms iteration = 8 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
5402024-11-19T02:15:45.724ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
5412024-11-19T02:15:45.724ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.286934ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
5422024-11-19T02:15:45.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
5432024-11-19T02:15:45.724ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
5442024-11-19T02:15:45.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
5452024-11-19T02:15:45.724ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
5462024-11-19T02:15:45.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
5472024-11-19T02:15:45.725ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-19 02:05:45.722715297 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
5482024-11-19T02:15:45.725ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 2.925344ms iteration = 7 status = {"expiration":"2024-11-19T02:05:45.722715297Z","pruned":[]}
5492024-11-19T02:15:45.725ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1243, tv_nsec: 512635499 } })
5502024-11-19T02:15:45.725ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
5512024-11-19T02:15:45.726ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
5522024-11-19T02:15:45.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5532024-11-19T02:15:45.726ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1243, tv_nsec: 513893753 } })
5542024-11-19T02:15:45.727ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5552024-11-19T02:15:45.727ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
5562024-11-19T02:15:45.727ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
5572024-11-19T02:15:45.727ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5582024-11-19T02:15:45.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5592024-11-19T02:15:45.727ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.652993ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
5602024-11-19T02:15:45.730ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
5612024-11-19T02:15:45.730ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5622024-11-19T02:15:45.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5632024-11-19T02:15:45.730ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5642024-11-19T02:15:45.730ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5652024-11-19T02:15:45.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5662024-11-19T02:15:45.732ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5672024-11-19T02:15:45.732ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5682024-11-19T02:15:45.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5692024-11-19T02:15:45.734ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5702024-11-19T02:15:45.734ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
5712024-11-19T02:15:45.734ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
5722024-11-19T02:15:45.734ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5732024-11-19T02:15:45.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
5742024-11-19T02:15:45.734ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5752024-11-19T02:15:45.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5762024-11-19T02:15:45.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5772024-11-19T02:15:45.736ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
5782024-11-19T02:15:45.736ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5792024-11-19T02:15:45.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5802024-11-19T02:15:45.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5812024-11-19T02:15:45.737ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5822024-11-19T02:15:45.738ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 15.609449ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
5832024-11-19T02:15:45.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5842024-11-19T02:15:45.740ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5852024-11-19T02:15:45.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5862024-11-19T02:15:45.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
5872024-11-19T02:15:45.740ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5882024-11-19T02:15:45.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5892024-11-19T02:15:45.746ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5902024-11-19T02:15:45.748ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5912024-11-19T02:15:45.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5922024-11-19T02:15:45.750ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
5932024-11-19T02:15:45.752ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5942024-11-19T02:15:45.754ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5952024-11-19T02:15:45.754ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5962024-11-19T02:15:45.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5972024-11-19T02:15:45.757ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1243, tv_nsec: 544247081 } })
5982024-11-19T02:15:45.757ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
5992024-11-19T02:15:45.775ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
6002024-11-19T02:15:45.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
6012024-11-19T02:15:45.782ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6022024-11-19T02:15:45.783ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6032024-11-19T02:15:45.785ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 61.98462ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
6042024-11-19T02:15:45.785ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
6052024-11-19T02:15:45.785ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6062024-11-19T02:15:45.785ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
6072024-11-19T02:15:45.785ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 62.803599ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
6082024-11-19T02:15:45.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6092024-11-19T02:15:45.786ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
6102024-11-19T02:15:45.786ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
6112024-11-19T02:15:45.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
6122024-11-19T02:15:45.786ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 63.570038ms iteration = 13 status = {"errors":[],"records_set_to_done":[]}
6132024-11-19T02:15:45.786ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6142024-11-19T02:15:45.787ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6152024-11-19T02:15:45.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6162024-11-19T02:15:45.788ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6172024-11-19T02:15:45.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6182024-11-19T02:15:45.788ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6192024-11-19T02:15:45.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6202024-11-19T02:15:45.789ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
6212024-11-19T02:15:45.789ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
6222024-11-19T02:15:45.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
6232024-11-19T02:15:45.792ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6242024-11-19T02:15:45.793ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
6252024-11-19T02:15:45.793ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
6262024-11-19T02:15:45.793ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 70.081232ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
6272024-11-19T02:15:45.795ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
6282024-11-19T02:15:45.795ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
6292024-11-19T02:15:45.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
6302024-11-19T02:15:45.796ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6312024-11-19T02:15:45.798ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
6322024-11-19T02:15:45.798ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
6332024-11-19T02:15:45.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
6342024-11-19T02:15:45.799ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6352024-11-19T02:15:45.799ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6362024-11-19T02:15:45.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6372024-11-19T02:15:45.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6382024-11-19T02:15:45.799ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6392024-11-19T02:15:45.799ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
6402024-11-19T02:15:45.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
6412024-11-19T02:15:45.801ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
6422024-11-19T02:15:45.801ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
6432024-11-19T02:15:45.801ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6442024-11-19T02:15:45.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
6452024-11-19T02:15:45.802ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6462024-11-19T02:15:45.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6472024-11-19T02:15:45.802ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
6482024-11-19T02:15:45.802ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
6492024-11-19T02:15:45.802ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
6502024-11-19T02:15:45.802ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6512024-11-19T02:15:45.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6522024-11-19T02:15:45.804ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 81.567674ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6532024-11-19T02:15:45.804ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6542024-11-19T02:15:45.804ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
6552024-11-19T02:15:45.804ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6562024-11-19T02:15:45.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6572024-11-19T02:15:45.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
6582024-11-19T02:15:45.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6592024-11-19T02:15:45.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6602024-11-19T02:15:45.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
6612024-11-19T02:15:45.806ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
6622024-11-19T02:15:45.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
6632024-11-19T02:15:45.807ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
6642024-11-19T02:15:45.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
6652024-11-19T02:15:45.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
6662024-11-19T02:15:45.810ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 87.589863ms iteration = 13 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
6672024-11-19T02:15:45.811ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6682024-11-19T02:15:45.812ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 89.613866ms iteration = 4 status = {"nsuccess":5}
6692024-11-19T02:15:45.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
6702024-11-19T02:15:45.815ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6712024-11-19T02:15:45.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6722024-11-19T02:15:45.824ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6732024-11-19T02:15:45.825ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
6742024-11-19T02:15:45.825ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 102.285191ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
6752024-11-19T02:15:45.825ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 102.736726ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
6762024-11-19T02:15:45.827ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
6772024-11-19T02:15:45.827ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6782024-11-19T02:15:45.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6792024-11-19T02:15:45.829ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6802024-11-19T02:15:45.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6812024-11-19T02:15:45.831ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6822024-11-19T02:15:45.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6832024-11-19T02:15:45.833ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6842024-11-19T02:15:45.836ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: ffe74824-0c08-48e1-a755-fb123e8dc181, lookup_type: ById(ffe74824-0c08-48e1-a755-fb123e8dc181) } result = Ok(())
6852024-11-19T02:15:45.836ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6862024-11-19T02:15:45.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6872024-11-19T02:15:45.837ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d49b62cb-14c3-4c62-99a0-7b0782d121a1 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
6882024-11-19T02:15:45.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d49b62cb-14c3-4c62-99a0-7b0782d121a1 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
6892024-11-19T02:15:45.838ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 115.000166ms iteration = 13 status = 0
6902024-11-19T02:15:45.839ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1989 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d49b62cb-14c3-4c62-99a0-7b0782d121a1 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
6912024-11-19T02:15:45.840ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
6922024-11-19T02:15:45.840ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
6932024-11-19T02:15:45.840ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
6942024-11-19T02:15:45.840ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6952024-11-19T02:15:45.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6962024-11-19T02:15:45.841ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6972024-11-19T02:15:45.842ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 119.809921ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
6982024-11-19T02:15:45.844ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6992024-11-19T02:15:45.844ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
7002024-11-19T02:15:45.844ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 121.028816ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
7012024-11-19T02:15:45.844ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
7022024-11-19T02:15:45.844ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
7032024-11-19T02:15:45.844ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 121.615302ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
7042024-11-19T02:15:45.846ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
7052024-11-19T02:15:45.846ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7062024-11-19T02:15:45.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7072024-11-19T02:15:45.850ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7082024-11-19T02:15:45.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
7092024-11-19T02:15:45.852ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7102024-11-19T02:15:45.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7112024-11-19T02:15:45.861ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 138.292452ms iteration = 16 status = {"physical_disks_added":0}
7122024-11-19T02:15:45.861ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
7132024-11-19T02:15:45.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
7142024-11-19T02:15:45.862ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
7152024-11-19T02:15:45.862ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 8c04fa4d-031f-4603-9b0e-246b45d39276 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
7162024-11-19T02:15:45.862ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7172024-11-19T02:15:45.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7182024-11-19T02:15:45.863ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7192024-11-19T02:15:45.863ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7202024-11-19T02:15:45.866ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
7212024-11-19T02:15:45.866ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7222024-11-19T02:15:45.867ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
7232024-11-19T02:15:45.867ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
7242024-11-19T02:15:45.867ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9abfde35-fea8-48ed-a028-bc914cb690b7", "content-length": "26", "date": "Tue, 19 Nov 2024 02:15:45 GMT"} })
7252024-11-19T02:15:45.867ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7262024-11-19T02:15:45.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
7272024-11-19T02:15:45.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
7282024-11-19T02:15:45.868ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7292024-11-19T02:15:45.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7302024-11-19T02:15:45.869ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
7312024-11-19T02:15:45.872ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
7322024-11-19T02:15:45.877ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
7332024-11-19T02:15:45.877ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = af79c7eb-bc4d-42f8-9217-8b35affeeebb dns_zone_name = oxide.test found_so_far = 0 version = 2
7342024-11-19T02:15:45.877ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7352024-11-19T02:15:45.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7362024-11-19T02:15:45.878ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7372024-11-19T02:15:45.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7382024-11-19T02:15:45.921ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
7392024-11-19T02:15:45.921ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 198.638483ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
7402024-11-19T02:15:45.942ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 zone_address = fd00:1122:3344:101::2
7412024-11-19T02:15:45.942ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7422024-11-19T02:15:45.942ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c543ec2d-ef5b-422d-ba55-02ce92d2e725", "content-length": "26", "date": "Tue, 19 Nov 2024 02:15:45 GMT"} })
7432024-11-19T02:15:45.942ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7442024-11-19T02:15:45.944ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
7452024-11-19T02:15:45.995ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
7462024-11-19T02:15:46.034ZINFOnexus (BackgroundTasks): VPC route manager sled ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
7472024-11-19T02:15:46.034ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7482024-11-19T02:15:46.035ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "be6e88cb-9c15-454c-9108-58be70657494", "content-length": "372", "date": "Tue, 19 Nov 2024 02:15:46 GMT"} })
7492024-11-19T02:15:46.035ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7502024-11-19T02:15:46.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7512024-11-19T02:15:46.037ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 8c04fa4d-031f-4603-9b0e-246b45d39276 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
7522024-11-19T02:15:46.037ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
7532024-11-19T02:15:46.037ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-19 02:10:27.714570 UTC dns_group = internal generation = 1
7542024-11-19T02:15:46.037ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 315.029016ms iteration = 8 status = {"generation":1}
7552024-11-19T02:15:46.038ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7562024-11-19T02:15:46.042ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
7572024-11-19T02:15:46.042ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7582024-11-19T02:15:46.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7592024-11-19T02:15:46.043ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
7602024-11-19T02:15:46.043ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7612024-11-19T02:15:46.043ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c18f2a20-7312-40a8-ab01-fba91d7651db", "content-length": "26", "date": "Tue, 19 Nov 2024 02:15:45 GMT"} })
7622024-11-19T02:15:46.043ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7632024-11-19T02:15:46.045ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = af79c7eb-bc4d-42f8-9217-8b35affeeebb dns_zone_name = oxide.test found_so_far = 1 version = 2
7642024-11-19T02:15:46.045ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
7652024-11-19T02:15:46.045ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-19 02:10:28.769117 UTC dns_group = external generation = 2
7662024-11-19T02:15:46.045ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 322.924296ms iteration = 8 status = {"generation":2}
7672024-11-19T02:15:46.045ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 323.070678ms iteration = 13 status = {}
7682024-11-19T02:15:46.046ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
7692024-11-19T02:15:46.047ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7702024-11-19T02:15:46.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7712024-11-19T02:15:46.049ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7722024-11-19T02:15:46.052ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7732024-11-19T02:15:46.053ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7742024-11-19T02:15:46.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7752024-11-19T02:15:46.055ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7762024-11-19T02:15:46.057ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7772024-11-19T02:15:46.057ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7782024-11-19T02:15:46.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7792024-11-19T02:15:46.060ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
7802024-11-19T02:15:46.105ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-19T02:09:41.910054Z, time_modified: 2024-11-19T02:09:41.910054Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 78638afa-e975-44a9-b764-0afec18d156f, db_silo: Silo { identity: SiloIdentity { id: 78638afa-e975-44a9-b764-0afec18d156f, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-19T02:10:28.623188Z, time_modified: 2024-11-19T02:10:28.623188Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "fe94815f3f5502a309deafc95cd58d4fe61e984b7bd8ad11309589068beb64f5" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 78638afa-e975-44a9-b764-0afec18d156f, db_silo: Silo { identity: SiloIdentity { id: 78638afa-e975-44a9-b764-0afec18d156f, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-19T02:10:28.623188Z, time_modified: 2024-11-19T02:10:28.623188Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "fe94815f3f5502a309deafc95cd58d4fe61e984b7bd8ad11309589068beb64f5" }] }) }
7812024-11-19T02:15:46.106ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 383.253846ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"78638afa-e975-44a9-b764-0afec18d156f","tls_certs":["fe94815f3f5502a309deafc95cd58d4fe61e984b7bd8ad11309589068beb64f5"]}},"default_endpoint":{"silo_id":"78638afa-e975-44a9-b764-0afec18d156f","tls_certs":["fe94815f3f5502a309deafc95cd58d4fe61e984b7bd8ad11309589068beb64f5"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
7822024-11-19T02:15:46.124ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
7832024-11-19T02:15:46.124ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
7842024-11-19T02:15:46.125ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "afa3fb3e-029a-4faa-9f2c-9c7f46dbbbb9", "date": "Tue, 19 Nov 2024 02:15:46 GMT"} })
7852024-11-19T02:15:46.125ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7862024-11-19T02:15:46.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7872024-11-19T02:15:46.128ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7882024-11-19T02:15:46.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7892024-11-19T02:15:46.132ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7902024-11-19T02:15:46.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7912024-11-19T02:15:46.139ZINFOnexus (BackgroundTasks): VPC route manager sled ffe74824-0c08-48e1-a755-fb123e8dc181 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
7922024-11-19T02:15:46.139ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7932024-11-19T02:15:46.139ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "9a8ef495-57e4-410d-ac15-1e93ceab2711", "date": "Tue, 19 Nov 2024 02:15:46 GMT"} })
7942024-11-19T02:15:46.142ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 419.301059ms iteration = 14 status = {}
7952024-11-19T02:15:46.197ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
7962024-11-19T02:15:46.198ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "e0ec3b45-2e39-4e18-940e-8643b918043c", "date": "Tue, 19 Nov 2024 02:15:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
7972024-11-19T02:15:46.198ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
7982024-11-19T02:15:46.201ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "ce6112bb-b63e-4ebd-a1d8-028961c27f7d", "date": "Tue, 19 Nov 2024 02:15:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
7992024-11-19T02:15:46.201ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
8002024-11-19T02:15:46.202ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
8012024-11-19T02:15:46.202ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 479.838382ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
8022024-11-19T02:15:46.216ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
8032024-11-19T02:15:46.216ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "f61e6135-95cc-40d2-965c-f18e51d5edaf", "content-length": "1", "date": "Tue, 19 Nov 2024 02:15:45 GMT"} })
8042024-11-19T02:15:46.218ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
8052024-11-19T02:15:46.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
8062024-11-19T02:15:46.222ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 499.423256ms iteration = 13 status = null
8072024-11-19T02:15:46.228ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
8082024-11-19T02:15:46.229ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "f98e1f2f-b839-4c73-a84c-2d0eaab1b64b", "date": "Tue, 19 Nov 2024 02:15:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
8092024-11-19T02:15:46.229ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
8102024-11-19T02:15:46.230ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "3c6919ff-6a43-4801-a395-b956c584f889", "date": "Tue, 19 Nov 2024 02:15:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
8112024-11-19T02:15:46.230ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
8122024-11-19T02:15:46.232ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "ed270acc-1408-4a1a-a063-30f4cc799edd", "date": "Tue, 19 Nov 2024 02:15:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
8132024-11-19T02:15:46.232ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
8142024-11-19T02:15:46.234ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
8152024-11-19T02:15:46.234ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 511.533775ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
8162024-11-19T02:15:46.286ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
8172024-11-19T02:15:46.287ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f0bc33d1-22e2-44e9-b71b-1bff5ef17249", "content-length": "691", "date": "Tue, 19 Nov 2024 02:15:46 GMT"} })
8182024-11-19T02:15:46.287ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
8192024-11-19T02:15:46.287ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
8202024-11-19T02:15:46.287ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
8212024-11-19T02:15:46.289ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 566.012608ms iteration = 13 status = {}
8222024-11-19T02:15:46.328ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8232024-11-19T02:15:46.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8242024-11-19T02:15:46.331ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 20bc3881-e2ee-4d8d-b84b-b0c1e478721f, rack_id: a894e92e-d765-4f15-b6b7-cb9ca46d1860, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8597d802-6d4d-4493-88de-333a1f340c20) } rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0
8252024-11-19T02:15:46.331ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8262024-11-19T02:15:46.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8272024-11-19T02:15:46.342ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
8282024-11-19T02:15:46.343ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "be5778b5-e1ce-419a-b238-1c22430424a4", "content-length": "134", "date": "Tue, 19 Nov 2024 02:15:45 GMT"} })
8292024-11-19T02:15:46.343ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
8302024-11-19T02:15:46.343ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8597d802-6d4d-4493-88de-333a1f340c20
8312024-11-19T02:15:46.343ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
8322024-11-19T02:15:46.343ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
8332024-11-19T02:15:46.343ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8342024-11-19T02:15:46.343ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8352024-11-19T02:15:46.343ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8362024-11-19T02:15:46.343ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
8372024-11-19T02:15:46.343ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8382024-11-19T02:15:46.343ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
8392024-11-19T02:15:46.343ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
8402024-11-19T02:15:46.343ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8412024-11-19T02:15:46.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8422024-11-19T02:15:46.345ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
8432024-11-19T02:15:46.345ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "6db502fe-258c-4785-ba77-f47f4ca5e0b0", "content-length": "2", "date": "Tue, 19 Nov 2024 02:15:45 GMT"} })
8442024-11-19T02:15:46.345ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
8452024-11-19T02:15:46.346ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "3efbab2b-bcd5-4f2d-83fa-0c58ecbf96cd", "content-length": "52", "date": "Tue, 19 Nov 2024 02:15:45 GMT"} })
8462024-11-19T02:15:46.346ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0
8472024-11-19T02:15:46.346ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
8482024-11-19T02:15:46.459ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "27464145-777e-4c9c-b84e-9b0029442fe4", "date": "Tue, 19 Nov 2024 02:15:46 GMT"} })
8492024-11-19T02:15:46.459ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch = Switch0
8502024-11-19T02:15:46.459ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
8512024-11-19T02:15:46.459ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c8919fad-e8a3-4c2e-af7d-2c1fe568e9a7", "content-length": "682", "date": "Tue, 19 Nov 2024 02:15:46 GMT"} })
8522024-11-19T02:15:46.459ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8532024-11-19T02:15:46.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8542024-11-19T02:15:46.464ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8552024-11-19T02:15:46.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8562024-11-19T02:15:46.468ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8572024-11-19T02:15:46.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8582024-11-19T02:15:46.470ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8592024-11-19T02:15:46.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8602024-11-19T02:15:46.478ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 755.578378ms iteration = 13 status = {}
8612024-11-19T02:15:46.700ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = aabf24de-7614-41cd-8800-6f4e6f4e9bc8 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
8622024-11-19T02:15:46.701ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = aabf24de-7614-41cd-8800-6f4e6f4e9bc8 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
8632024-11-19T02:15:46.703ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2590 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = aabf24de-7614-41cd-8800-6f4e6f4e9bc8 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
8642024-11-19T02:15:46.864ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 76f055c4-b5a2-4980-b20c-f71870f7eebb roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
8652024-11-19T02:15:46.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 76f055c4-b5a2-4980-b20c-f71870f7eebb resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
8662024-11-19T02:15:46.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1916 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 76f055c4-b5a2-4980-b20c-f71870f7eebb response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
8672024-11-19T02:15:47.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e47d2d2f-34dc-44ee-8d41-cb58126deac5 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
8682024-11-19T02:15:47.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e47d2d2f-34dc-44ee-8d41-cb58126deac5 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
8692024-11-19T02:15:47.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2105 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e47d2d2f-34dc-44ee-8d41-cb58126deac5 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
8702024-11-19T02:15:48.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 692276f4-ec46-4284-907b-c6aafcd66066 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
8712024-11-19T02:15:48.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 692276f4-ec46-4284-907b-c6aafcd66066 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
8722024-11-19T02:15:48.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2133 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 692276f4-ec46-4284-907b-c6aafcd66066 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
8732024-11-19T02:15:49.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9a844b62-599e-4a29-bad9-2cc58502ee6e roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
8742024-11-19T02:15:49.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9a844b62-599e-4a29-bad9-2cc58502ee6e resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
8752024-11-19T02:15:49.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2397 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9a844b62-599e-4a29-bad9-2cc58502ee6e response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
8762024-11-19T02:15:50.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 164a4f5f-f946-4724-b321-2d6b455140e0 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
8772024-11-19T02:15:50.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 164a4f5f-f946-4724-b321-2d6b455140e0 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
8782024-11-19T02:15:50.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1768 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 164a4f5f-f946-4724-b321-2d6b455140e0 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
8792024-11-19T02:15:51.981ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 8b12445c-9a76-4b33-a22f-0e631642d774 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
8802024-11-19T02:15:51.981ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 8b12445c-9a76-4b33-a22f-0e631642d774 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
8812024-11-19T02:15:51.983ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2092 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 8b12445c-9a76-4b33-a22f-0e631642d774 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
8822024-11-19T02:15:52.152ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1633 local_addr = [fd00:1122:3344:101::c]:60807 method = GET remote_addr = [fd00:1122:3344:101::d]:57844 req_id = ec981698-a2ed-4409-9278-aebd22148457 response_code = 200 uri = /9f0b435f-0000-451e-9dbc-dcec71543c30
8832024-11-19T02:15:53.005ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 7fa6fc6d-c261-4455-84e8-62d9bdbae335 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
8842024-11-19T02:15:53.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 7fa6fc6d-c261-4455-84e8-62d9bdbae335 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
8852024-11-19T02:15:53.007ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2309 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 7fa6fc6d-c261-4455-84e8-62d9bdbae335 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
8862024-11-19T02:15:54.028ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6ae15444-c367-4feb-b884-73a12dd94270 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
8872024-11-19T02:15:54.028ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6ae15444-c367-4feb-b884-73a12dd94270 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
8882024-11-19T02:15:54.030ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2337 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6ae15444-c367-4feb-b884-73a12dd94270 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
8892024-11-19T02:15:55.051ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6149f255-28cc-4907-924a-54679e42bcd5 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
8902024-11-19T02:15:55.051ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6149f255-28cc-4907-924a-54679e42bcd5 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
8912024-11-19T02:15:55.053ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1985 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6149f255-28cc-4907-924a-54679e42bcd5 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
8922024-11-19T02:15:55.723ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
8932024-11-19T02:15:55.723ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8942024-11-19T02:15:55.723ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
8952024-11-19T02:15:55.723ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8962024-11-19T02:15:55.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8972024-11-19T02:15:55.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8982024-11-19T02:15:55.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8992024-11-19T02:15:55.728ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9002024-11-19T02:15:55.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9012024-11-19T02:15:55.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9022024-11-19T02:15:55.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9032024-11-19T02:15:55.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9042024-11-19T02:15:55.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9052024-11-19T02:15:55.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
9062024-11-19T02:15:55.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9072024-11-19T02:15:55.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9082024-11-19T02:15:55.748ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
9092024-11-19T02:15:55.748ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.573221ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
9102024-11-19T02:15:55.754ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9112024-11-19T02:15:55.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9122024-11-19T02:15:55.785ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.069171ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9132024-11-19T02:15:56.074ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b7b71461-cb3f-4619-b6b8-433eb538964a roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9142024-11-19T02:15:56.075ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b7b71461-cb3f-4619-b6b8-433eb538964a resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9152024-11-19T02:15:56.076ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2029 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b7b71461-cb3f-4619-b6b8-433eb538964a response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9162024-11-19T02:15:57.096ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 30e55531-a300-489e-98ec-1ab65c15082f roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9172024-11-19T02:15:57.097ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 30e55531-a300-489e-98ec-1ab65c15082f resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9182024-11-19T02:15:57.099ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2600 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 30e55531-a300-489e-98ec-1ab65c15082f response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9192024-11-19T02:15:58.120ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 54aa7efd-9b73-4a0a-bb40-2538da1b3a79 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9202024-11-19T02:15:58.120ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 54aa7efd-9b73-4a0a-bb40-2538da1b3a79 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9212024-11-19T02:15:58.122ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2214 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 54aa7efd-9b73-4a0a-bb40-2538da1b3a79 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9222024-11-19T02:15:59.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9843c200-c396-4745-b8e2-8c6464b27e28 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9232024-11-19T02:15:59.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9843c200-c396-4745-b8e2-8c6464b27e28 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9242024-11-19T02:15:59.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2506 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9843c200-c396-4745-b8e2-8c6464b27e28 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9252024-11-19T02:16:00.168ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4536173a-fc06-4477-8c27-14ada835e72f roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9262024-11-19T02:16:00.168ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4536173a-fc06-4477-8c27-14ada835e72f resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9272024-11-19T02:16:00.169ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1691 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4536173a-fc06-4477-8c27-14ada835e72f response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9282024-11-19T02:16:01.191ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 40ec4403-2c4a-446e-8761-519eb8689092 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9292024-11-19T02:16:01.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 40ec4403-2c4a-446e-8761-519eb8689092 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9302024-11-19T02:16:01.193ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2131 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 40ec4403-2c4a-446e-8761-519eb8689092 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9312024-11-19T02:16:02.213ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ce1bc345-6479-4401-a418-e72136693746 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9322024-11-19T02:16:02.214ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ce1bc345-6479-4401-a418-e72136693746 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9332024-11-19T02:16:02.215ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2280 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ce1bc345-6479-4401-a418-e72136693746 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9342024-11-19T02:16:03.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4c61b712-29db-4531-9b00-81ef975425ee roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9352024-11-19T02:16:03.237ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4c61b712-29db-4531-9b00-81ef975425ee resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9362024-11-19T02:16:03.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2194 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4c61b712-29db-4531-9b00-81ef975425ee response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9372024-11-19T02:16:04.259ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = f9f5088d-8b81-42a3-9038-aa9a385adfb7 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9382024-11-19T02:16:04.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = f9f5088d-8b81-42a3-9038-aa9a385adfb7 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9392024-11-19T02:16:04.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2581 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = f9f5088d-8b81-42a3-9038-aa9a385adfb7 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9402024-11-19T02:16:05.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c91ad3c5-de84-4557-8185-31ad7f2e13ec roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9412024-11-19T02:16:05.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c91ad3c5-de84-4557-8185-31ad7f2e13ec resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9422024-11-19T02:16:05.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1772 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c91ad3c5-de84-4557-8185-31ad7f2e13ec response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9432024-11-19T02:16:05.723ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
9442024-11-19T02:16:05.723ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9452024-11-19T02:16:05.723ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
9462024-11-19T02:16:05.723ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9472024-11-19T02:16:05.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9482024-11-19T02:16:05.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9492024-11-19T02:16:05.725ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9502024-11-19T02:16:05.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9512024-11-19T02:16:05.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9522024-11-19T02:16:05.727ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.713032ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9532024-11-19T02:16:05.727ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9542024-11-19T02:16:05.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9552024-11-19T02:16:05.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9562024-11-19T02:16:05.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9572024-11-19T02:16:05.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9582024-11-19T02:16:05.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9592024-11-19T02:16:05.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
9602024-11-19T02:16:05.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9612024-11-19T02:16:05.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9622024-11-19T02:16:05.744ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
9632024-11-19T02:16:05.744ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.254263ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
9642024-11-19T02:16:06.306ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b8a7db6a-c3e0-404f-a15c-b114fb70045b roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9652024-11-19T02:16:06.307ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b8a7db6a-c3e0-404f-a15c-b114fb70045b resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9662024-11-19T02:16:06.308ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1744 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b8a7db6a-c3e0-404f-a15c-b114fb70045b response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9672024-11-19T02:16:07.151ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1343 local_addr = [fd00:1122:3344:101::c]:60807 method = GET remote_addr = [fd00:1122:3344:101::d]:57844 req_id = 3a3f7d49-f685-4ddd-b225-66eaaf3e4893 response_code = 200 uri = /9f0b435f-0000-451e-9dbc-dcec71543c30
9682024-11-19T02:16:07.328ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e77851fd-e273-4c93-b20a-bfc3801ca861 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9692024-11-19T02:16:07.329ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e77851fd-e273-4c93-b20a-bfc3801ca861 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9702024-11-19T02:16:07.330ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1985 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e77851fd-e273-4c93-b20a-bfc3801ca861 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9712024-11-19T02:16:08.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e738f923-7bd1-49f5-a3d1-2b6b07dbcf24 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9722024-11-19T02:16:08.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e738f923-7bd1-49f5-a3d1-2b6b07dbcf24 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9732024-11-19T02:16:08.354ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2206 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e738f923-7bd1-49f5-a3d1-2b6b07dbcf24 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9742024-11-19T02:16:09.375ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3e90af63-cf5d-4a9c-a286-d0b1fd5a658e roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9752024-11-19T02:16:09.375ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3e90af63-cf5d-4a9c-a286-d0b1fd5a658e resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9762024-11-19T02:16:09.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1541 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3e90af63-cf5d-4a9c-a286-d0b1fd5a658e response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9772024-11-19T02:16:10.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3ea7b4ce-22b9-409d-b432-920d86513076 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9782024-11-19T02:16:10.398ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3ea7b4ce-22b9-409d-b432-920d86513076 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9792024-11-19T02:16:10.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1990 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3ea7b4ce-22b9-409d-b432-920d86513076 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9802024-11-19T02:16:11.421ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e7eed9ed-55fe-40bd-88c8-79f28b3a2b41 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9812024-11-19T02:16:11.421ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e7eed9ed-55fe-40bd-88c8-79f28b3a2b41 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9822024-11-19T02:16:11.423ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2194 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e7eed9ed-55fe-40bd-88c8-79f28b3a2b41 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9832024-11-19T02:16:12.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d6527d11-123e-465a-b3c6-a473c128fa2e roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9842024-11-19T02:16:12.444ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d6527d11-123e-465a-b3c6-a473c128fa2e resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9852024-11-19T02:16:12.446ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2319 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d6527d11-123e-465a-b3c6-a473c128fa2e response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9862024-11-19T02:16:13.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 5853811a-cc9e-4001-8231-ad5b2222aa9c roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9872024-11-19T02:16:13.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 5853811a-cc9e-4001-8231-ad5b2222aa9c resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9882024-11-19T02:16:13.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2172 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 5853811a-cc9e-4001-8231-ad5b2222aa9c response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9892024-11-19T02:16:14.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = db172d08-6612-44ac-ac4e-4842b78dba27 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9902024-11-19T02:16:14.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = db172d08-6612-44ac-ac4e-4842b78dba27 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9912024-11-19T02:16:14.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1980 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = db172d08-6612-44ac-ac4e-4842b78dba27 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9922024-11-19T02:16:15.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c45ebd62-6989-46f2-9745-c61d4783dcb3 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9932024-11-19T02:16:15.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c45ebd62-6989-46f2-9745-c61d4783dcb3 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9942024-11-19T02:16:15.515ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2184 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c45ebd62-6989-46f2-9745-c61d4783dcb3 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
9952024-11-19T02:16:15.722ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
9962024-11-19T02:16:15.722ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
9972024-11-19T02:16:15.722ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
9982024-11-19T02:16:15.722ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
9992024-11-19T02:16:15.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
10002024-11-19T02:16:15.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
10012024-11-19T02:16:15.722ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
10022024-11-19T02:16:15.722ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
10032024-11-19T02:16:15.722ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
10042024-11-19T02:16:15.722ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10052024-11-19T02:16:15.722ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
10062024-11-19T02:16:15.722ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
10072024-11-19T02:16:15.722ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10082024-11-19T02:16:15.722ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
10092024-11-19T02:16:15.722ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
10102024-11-19T02:16:15.722ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
10112024-11-19T02:16:15.722ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
10122024-11-19T02:16:15.722ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10132024-11-19T02:16:15.722ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
10142024-11-19T02:16:15.722ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
10152024-11-19T02:16:15.722ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
10162024-11-19T02:16:15.722ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10172024-11-19T02:16:15.722ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
10182024-11-19T02:16:15.722ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
10192024-11-19T02:16:15.722ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10202024-11-19T02:16:15.722ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
10212024-11-19T02:16:15.722ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10222024-11-19T02:16:15.722ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
10232024-11-19T02:16:15.722ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10242024-11-19T02:16:15.722ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
10252024-11-19T02:16:15.722ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
10262024-11-19T02:16:15.722ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
10272024-11-19T02:16:15.722ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10282024-11-19T02:16:15.722ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
10292024-11-19T02:16:15.722ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10302024-11-19T02:16:15.722ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
10312024-11-19T02:16:15.722ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10322024-11-19T02:16:15.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
10332024-11-19T02:16:15.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
10342024-11-19T02:16:15.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10352024-11-19T02:16:15.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10362024-11-19T02:16:15.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
10372024-11-19T02:16:15.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10382024-11-19T02:16:15.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10392024-11-19T02:16:15.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10402024-11-19T02:16:15.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10412024-11-19T02:16:15.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
10422024-11-19T02:16:15.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10432024-11-19T02:16:15.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10442024-11-19T02:16:15.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10452024-11-19T02:16:15.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
10462024-11-19T02:16:15.724ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1273, tv_nsec: 511390435 } })
10472024-11-19T02:16:15.724ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1273, tv_nsec: 511497326 } })
10482024-11-19T02:16:15.724ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
10492024-11-19T02:16:15.724ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
10502024-11-19T02:16:15.725ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10512024-11-19T02:16:15.726ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.670152ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
10522024-11-19T02:16:15.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10532024-11-19T02:16:15.727ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10542024-11-19T02:16:15.727ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10552024-11-19T02:16:15.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10562024-11-19T02:16:15.729ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10572024-11-19T02:16:15.730ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
10582024-11-19T02:16:15.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10592024-11-19T02:16:15.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10602024-11-19T02:16:15.731ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
10612024-11-19T02:16:15.731ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10622024-11-19T02:16:15.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10632024-11-19T02:16:15.732ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10642024-11-19T02:16:15.733ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10652024-11-19T02:16:15.734ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10662024-11-19T02:16:15.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10672024-11-19T02:16:15.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10682024-11-19T02:16:15.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
10692024-11-19T02:16:15.735ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10702024-11-19T02:16:15.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10712024-11-19T02:16:15.736ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10722024-11-19T02:16:15.736ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10732024-11-19T02:16:15.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10742024-11-19T02:16:15.736ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10752024-11-19T02:16:15.736ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10762024-11-19T02:16:15.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10772024-11-19T02:16:15.738ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10782024-11-19T02:16:15.738ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1273, tv_nsec: 525877261 } })
10792024-11-19T02:16:15.739ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10802024-11-19T02:16:15.739ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
10812024-11-19T02:16:15.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10822024-11-19T02:16:15.739ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10832024-11-19T02:16:15.739ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10842024-11-19T02:16:15.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10852024-11-19T02:16:15.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10862024-11-19T02:16:15.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
10872024-11-19T02:16:15.740ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10882024-11-19T02:16:15.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10892024-11-19T02:16:15.753ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10902024-11-19T02:16:15.755ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
10912024-11-19T02:16:15.755ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10922024-11-19T02:16:15.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
10932024-11-19T02:16:15.758ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 35.81786ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
10942024-11-19T02:16:15.760ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10952024-11-19T02:16:15.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10962024-11-19T02:16:15.761ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
10972024-11-19T02:16:15.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
10982024-11-19T02:16:15.763ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
10992024-11-19T02:16:15.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
11002024-11-19T02:16:15.763ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11012024-11-19T02:16:15.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11022024-11-19T02:16:15.763ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11032024-11-19T02:16:15.763ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
11042024-11-19T02:16:15.763ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11052024-11-19T02:16:15.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11062024-11-19T02:16:15.770ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11072024-11-19T02:16:15.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11082024-11-19T02:16:15.775ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 52.328319ms iteration = 14 status = {"errors":[],"records_set_to_done":[]}
11092024-11-19T02:16:15.779ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11102024-11-19T02:16:15.781ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
11112024-11-19T02:16:15.781ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11122024-11-19T02:16:15.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11132024-11-19T02:16:15.836ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
11142024-11-19T02:16:15.836ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11152024-11-19T02:16:15.836ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fe1a7801-560a-4e27-be90-564918bd9083", "content-length": "26", "date": "Tue, 19 Nov 2024 02:16:15 GMT"} })
11162024-11-19T02:16:15.836ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11172024-11-19T02:16:15.838ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
11182024-11-19T02:16:15.850ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11192024-11-19T02:16:15.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11202024-11-19T02:16:15.868ZINFOnexus (BackgroundTasks): VPC route manager sled ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
11212024-11-19T02:16:15.868ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
11222024-11-19T02:16:15.869ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1dfb7fdb-7e2b-4b0f-bd55-41a6c612f949", "content-length": "372", "date": "Tue, 19 Nov 2024 02:16:15 GMT"} })
11232024-11-19T02:16:15.869ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11242024-11-19T02:16:15.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11252024-11-19T02:16:15.873ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11262024-11-19T02:16:15.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11272024-11-19T02:16:15.874ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11282024-11-19T02:16:15.876ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
11292024-11-19T02:16:15.876ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11302024-11-19T02:16:15.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11312024-11-19T02:16:15.879ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
11322024-11-19T02:16:15.879ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 156.296939ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
11332024-11-19T02:16:15.905ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 182.708281ms iteration = 14 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
11342024-11-19T02:16:15.910ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
11352024-11-19T02:16:15.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
11362024-11-19T02:16:15.911ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
11372024-11-19T02:16:15.911ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 188.827851ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
11382024-11-19T02:16:15.913ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 190.249758ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
11392024-11-19T02:16:15.914ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11402024-11-19T02:16:15.915ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11412024-11-19T02:16:15.916ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 193.172821ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
11422024-11-19T02:16:15.916ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
11432024-11-19T02:16:15.916ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11442024-11-19T02:16:15.916ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "daba6c6e-918f-4f5a-b02e-6d35b3e38716", "content-length": "26", "date": "Tue, 19 Nov 2024 02:16:15 GMT"} })
11452024-11-19T02:16:15.916ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11462024-11-19T02:16:15.918ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: ffe74824-0c08-48e1-a755-fb123e8dc181, lookup_type: ById(ffe74824-0c08-48e1-a755-fb123e8dc181) } result = Ok(())
11472024-11-19T02:16:15.918ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11482024-11-19T02:16:15.918ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11492024-11-19T02:16:15.918ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
11502024-11-19T02:16:15.918ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11512024-11-19T02:16:15.918ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
11522024-11-19T02:16:15.918ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11532024-11-19T02:16:15.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11542024-11-19T02:16:15.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11552024-11-19T02:16:15.918ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
11562024-11-19T02:16:15.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11572024-11-19T02:16:15.920ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 197.467421ms iteration = 14 status = 0
11582024-11-19T02:16:15.926ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 203.607611ms iteration = 17 status = {"physical_disks_added":0}
11592024-11-19T02:16:15.938ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
11602024-11-19T02:16:15.939ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
11612024-11-19T02:16:15.939ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "2c049d4b-06a4-43f4-be07-198fd11af845", "date": "Tue, 19 Nov 2024 02:16:15 GMT"} })
11622024-11-19T02:16:15.939ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11632024-11-19T02:16:15.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11642024-11-19T02:16:15.942ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11652024-11-19T02:16:15.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11662024-11-19T02:16:15.946ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 zone_address = fd00:1122:3344:101::2
11672024-11-19T02:16:15.946ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11682024-11-19T02:16:15.946ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ce96d348-e9da-4a02-949a-dc8a1daacd9d", "content-length": "26", "date": "Tue, 19 Nov 2024 02:16:15 GMT"} })
11692024-11-19T02:16:15.946ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11702024-11-19T02:16:15.947ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11712024-11-19T02:16:15.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11722024-11-19T02:16:15.949ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
11732024-11-19T02:16:15.951ZINFOnexus (BackgroundTasks): VPC route manager sled ffe74824-0c08-48e1-a755-fb123e8dc181 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
11742024-11-19T02:16:15.951ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
11752024-11-19T02:16:15.952ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ace90a4a-525c-4696-8f13-b20dcdd338cd", "date": "Tue, 19 Nov 2024 02:16:15 GMT"} })
11762024-11-19T02:16:15.954ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 231.669772ms iteration = 15 status = {}
11772024-11-19T02:16:15.956ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 233.494542ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
11782024-11-19T02:16:15.960ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
11792024-11-19T02:16:15.960ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "7afd4b36-7fbf-40a1-a87e-57da006ead5c", "content-length": "1", "date": "Tue, 19 Nov 2024 02:16:15 GMT"} })
11802024-11-19T02:16:15.962ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
11812024-11-19T02:16:15.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
11822024-11-19T02:16:15.965ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 243.158674ms iteration = 14 status = null
11832024-11-19T02:16:15.967ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11842024-11-19T02:16:15.967ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
11852024-11-19T02:16:15.967ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 244.757572ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
11862024-11-19T02:16:16.017ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 295.566393ms iteration = 14 status = {}
11872024-11-19T02:16:16.050ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
11882024-11-19T02:16:16.050ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "b7b37899-3754-4b69-9e28-7f5933c48580", "content-length": "691", "date": "Tue, 19 Nov 2024 02:16:15 GMT"} })
11892024-11-19T02:16:16.050ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
11902024-11-19T02:16:16.050ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
11912024-11-19T02:16:16.050ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
11922024-11-19T02:16:16.053ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 331.033259ms iteration = 14 status = {}
11932024-11-19T02:16:16.095ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11942024-11-19T02:16:16.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11952024-11-19T02:16:16.097ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 20bc3881-e2ee-4d8d-b84b-b0c1e478721f, rack_id: a894e92e-d765-4f15-b6b7-cb9ca46d1860, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8597d802-6d4d-4493-88de-333a1f340c20) } rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0
11962024-11-19T02:16:16.097ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11972024-11-19T02:16:16.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11982024-11-19T02:16:16.108ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
11992024-11-19T02:16:16.108ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "385f9db7-5833-42d1-bfbf-1c9c2c9718e8", "content-length": "134", "date": "Tue, 19 Nov 2024 02:16:15 GMT"} })
12002024-11-19T02:16:16.108ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
12012024-11-19T02:16:16.108ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8597d802-6d4d-4493-88de-333a1f340c20
12022024-11-19T02:16:16.108ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
12032024-11-19T02:16:16.108ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
12042024-11-19T02:16:16.108ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12052024-11-19T02:16:16.108ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12062024-11-19T02:16:16.108ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12072024-11-19T02:16:16.108ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
12082024-11-19T02:16:16.109ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12092024-11-19T02:16:16.109ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
12102024-11-19T02:16:16.109ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
12112024-11-19T02:16:16.109ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12122024-11-19T02:16:16.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12132024-11-19T02:16:16.111ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
12142024-11-19T02:16:16.111ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "4497e77b-f455-46e4-9013-e24ca6dbcc96", "content-length": "2", "date": "Tue, 19 Nov 2024 02:16:15 GMT"} })
12152024-11-19T02:16:16.111ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
12162024-11-19T02:16:16.111ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ebddaf5-f684-4c5a-ba8f-d24005b19c63", "content-length": "52", "date": "Tue, 19 Nov 2024 02:16:15 GMT"} })
12172024-11-19T02:16:16.111ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0
12182024-11-19T02:16:16.111ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
12192024-11-19T02:16:16.222ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "baa511ab-ff3f-4272-a64a-2ea28f916dad", "date": "Tue, 19 Nov 2024 02:16:15 GMT"} })
12202024-11-19T02:16:16.222ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch = Switch0
12212024-11-19T02:16:16.222ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
12222024-11-19T02:16:16.222ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a8f5b15a-0f8b-4512-87d2-bbc86f70e0c7", "content-length": "682", "date": "Tue, 19 Nov 2024 02:16:16 GMT"} })
12232024-11-19T02:16:16.222ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12242024-11-19T02:16:16.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12252024-11-19T02:16:16.227ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12262024-11-19T02:16:16.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12272024-11-19T02:16:16.230ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12282024-11-19T02:16:16.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12292024-11-19T02:16:16.233ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12302024-11-19T02:16:16.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12312024-11-19T02:16:16.241ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 518.831299ms iteration = 14 status = {}
12322024-11-19T02:16:16.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 81bc3d51-1b17-48d6-80ea-b04b6db3c2f2 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
12332024-11-19T02:16:16.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 81bc3d51-1b17-48d6-80ea-b04b6db3c2f2 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
12342024-11-19T02:16:16.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2171 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 81bc3d51-1b17-48d6-80ea-b04b6db3c2f2 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
12352024-11-19T02:16:16.733ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = c0219a12-cb3a-408f-9f10-d9077d2f361b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
12362024-11-19T02:16:16.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = c0219a12-cb3a-408f-9f10-d9077d2f361b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
12372024-11-19T02:16:16.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3141 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = c0219a12-cb3a-408f-9f10-d9077d2f361b response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
12382024-11-19T02:16:17.560ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a5e09e2c-ee13-43da-9e28-f28c65af626a roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
12392024-11-19T02:16:17.560ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a5e09e2c-ee13-43da-9e28-f28c65af626a resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
12402024-11-19T02:16:17.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2865 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a5e09e2c-ee13-43da-9e28-f28c65af626a response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
12412024-11-19T02:16:18.584ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 514c152e-7730-4df7-9bfb-cae41bdfe44e roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
12422024-11-19T02:16:18.584ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 514c152e-7730-4df7-9bfb-cae41bdfe44e resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
12432024-11-19T02:16:18.586ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2340 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 514c152e-7730-4df7-9bfb-cae41bdfe44e response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
12442024-11-19T02:16:19.608ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e3b87db4-8905-45c3-90f7-d29000e2074f roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
12452024-11-19T02:16:19.608ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e3b87db4-8905-45c3-90f7-d29000e2074f resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
12462024-11-19T02:16:19.610ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2113 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e3b87db4-8905-45c3-90f7-d29000e2074f response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
12472024-11-19T02:16:20.631ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 631bfa5d-7520-441c-b4fb-822f6313a9d3 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
12482024-11-19T02:16:20.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 631bfa5d-7520-441c-b4fb-822f6313a9d3 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
12492024-11-19T02:16:20.633ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2414 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 631bfa5d-7520-441c-b4fb-822f6313a9d3 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
12502024-11-19T02:16:21.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ec256373-304d-4f0b-8398-1dde9f074c89 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
12512024-11-19T02:16:21.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ec256373-304d-4f0b-8398-1dde9f074c89 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
12522024-11-19T02:16:21.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3051 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ec256373-304d-4f0b-8398-1dde9f074c89 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
12532024-11-19T02:16:22.150ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1549 local_addr = [fd00:1122:3344:101::c]:60807 method = GET remote_addr = [fd00:1122:3344:101::d]:57844 req_id = ced9d231-d7c7-4d7b-ad91-f9498b9cdedb response_code = 200 uri = /9f0b435f-0000-451e-9dbc-dcec71543c30
12542024-11-19T02:16:22.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = efe03c9b-dc90-4326-9c87-908dbd5760d1 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
12552024-11-19T02:16:22.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = efe03c9b-dc90-4326-9c87-908dbd5760d1 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
12562024-11-19T02:16:22.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2124 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = efe03c9b-dc90-4326-9c87-908dbd5760d1 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
12572024-11-19T02:16:23.700ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 1337f809-a3d7-4e4f-9b35-b1a372362f02 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
12582024-11-19T02:16:23.701ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 1337f809-a3d7-4e4f-9b35-b1a372362f02 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
12592024-11-19T02:16:23.703ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2315 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 1337f809-a3d7-4e4f-9b35-b1a372362f02 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
12602024-11-19T02:16:24.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 7439cefc-1ba5-40ce-ab63-26aaf74c6b82 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
12612024-11-19T02:16:24.724ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 7439cefc-1ba5-40ce-ab63-26aaf74c6b82 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
12622024-11-19T02:16:24.726ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1961 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 7439cefc-1ba5-40ce-ab63-26aaf74c6b82 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
12632024-11-19T02:16:25.723ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
12642024-11-19T02:16:25.723ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
12652024-11-19T02:16:25.723ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12662024-11-19T02:16:25.723ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12672024-11-19T02:16:25.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12682024-11-19T02:16:25.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12692024-11-19T02:16:25.725ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12702024-11-19T02:16:25.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12712024-11-19T02:16:25.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12722024-11-19T02:16:25.728ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12732024-11-19T02:16:25.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12742024-11-19T02:16:25.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12752024-11-19T02:16:25.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12762024-11-19T02:16:25.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12772024-11-19T02:16:25.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12782024-11-19T02:16:25.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
12792024-11-19T02:16:25.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12802024-11-19T02:16:25.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12812024-11-19T02:16:25.743ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
12822024-11-19T02:16:25.744ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.427613ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
12832024-11-19T02:16:25.746ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 2dea0d06-00d2-41a2-9b60-f7215d0bb62c roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
12842024-11-19T02:16:25.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 2dea0d06-00d2-41a2-9b60-f7215d0bb62c resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
12852024-11-19T02:16:25.748ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1769 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 2dea0d06-00d2-41a2-9b60-f7215d0bb62c response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
12862024-11-19T02:16:25.755ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.278329ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12872024-11-19T02:16:26.770ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 532d4e8a-0284-476a-bf6b-959d7840dd0e roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
12882024-11-19T02:16:26.770ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 532d4e8a-0284-476a-bf6b-959d7840dd0e resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
12892024-11-19T02:16:26.772ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2397 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 532d4e8a-0284-476a-bf6b-959d7840dd0e response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
12902024-11-19T02:16:27.792ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 34be06b2-d2b3-42ec-8c08-05e5e9650b71 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
12912024-11-19T02:16:27.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 34be06b2-d2b3-42ec-8c08-05e5e9650b71 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
12922024-11-19T02:16:27.794ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2009 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 34be06b2-d2b3-42ec-8c08-05e5e9650b71 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
12932024-11-19T02:16:28.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 651f3695-5450-45a1-b6fb-cedb3525f1d0 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
12942024-11-19T02:16:28.819ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 651f3695-5450-45a1-b6fb-cedb3525f1d0 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
12952024-11-19T02:16:28.820ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2071 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 651f3695-5450-45a1-b6fb-cedb3525f1d0 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
12962024-11-19T02:16:29.841ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = fff2b90b-2cec-40d2-bd44-32e570173220 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
12972024-11-19T02:16:29.841ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = fff2b90b-2cec-40d2-bd44-32e570173220 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
12982024-11-19T02:16:29.843ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2403 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = fff2b90b-2cec-40d2-bd44-32e570173220 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
12992024-11-19T02:16:30.864ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 718b8bea-1a3a-4ca8-8e3d-c61fb738990f roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
13002024-11-19T02:16:30.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 718b8bea-1a3a-4ca8-8e3d-c61fb738990f resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
13012024-11-19T02:16:30.866ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2215 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 718b8bea-1a3a-4ca8-8e3d-c61fb738990f response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
13022024-11-19T02:16:31.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 402a180d-1992-4d68-b4ef-365dd8ef80c9 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
13032024-11-19T02:16:31.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 402a180d-1992-4d68-b4ef-365dd8ef80c9 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
13042024-11-19T02:16:31.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2035 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 402a180d-1992-4d68-b4ef-365dd8ef80c9 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
13052024-11-19T02:16:32.908ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b5b475bb-2605-4358-9887-ea08616887a8 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
13062024-11-19T02:16:32.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b5b475bb-2605-4358-9887-ea08616887a8 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
13072024-11-19T02:16:32.911ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2349 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b5b475bb-2605-4358-9887-ea08616887a8 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
13082024-11-19T02:16:33.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a2288856-a6b3-4c1c-94ea-e3654ed4d73e roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
13092024-11-19T02:16:33.932ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a2288856-a6b3-4c1c-94ea-e3654ed4d73e resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
13102024-11-19T02:16:33.934ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2489 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a2288856-a6b3-4c1c-94ea-e3654ed4d73e response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
13112024-11-19T02:16:34.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c631de1e-7c8e-4b83-896e-ef8871baf27e roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
13122024-11-19T02:16:34.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c631de1e-7c8e-4b83-896e-ef8871baf27e resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
13132024-11-19T02:16:34.959ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2871 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c631de1e-7c8e-4b83-896e-ef8871baf27e response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
13142024-11-19T02:16:35.723ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
13152024-11-19T02:16:35.723ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13162024-11-19T02:16:35.723ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
13172024-11-19T02:16:35.723ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13182024-11-19T02:16:35.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13192024-11-19T02:16:35.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13202024-11-19T02:16:35.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13212024-11-19T02:16:35.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13222024-11-19T02:16:35.725ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13232024-11-19T02:16:35.728ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
13242024-11-19T02:16:35.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13252024-11-19T02:16:35.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13262024-11-19T02:16:35.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13272024-11-19T02:16:35.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13282024-11-19T02:16:35.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13292024-11-19T02:16:35.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
13302024-11-19T02:16:35.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13312024-11-19T02:16:35.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13322024-11-19T02:16:35.746ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
13332024-11-19T02:16:35.746ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.646049ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
13342024-11-19T02:16:35.753ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.066814ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
13352024-11-19T02:16:35.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = fcd605d5-44bb-45bd-b9ff-968649df8dda roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
13362024-11-19T02:16:35.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = fcd605d5-44bb-45bd-b9ff-968649df8dda resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
13372024-11-19T02:16:35.981ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2021 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = fcd605d5-44bb-45bd-b9ff-968649df8dda response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
13382024-11-19T02:16:37.001ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ca778746-f21a-4639-a074-cc962075f0ab roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
13392024-11-19T02:16:37.002ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ca778746-f21a-4639-a074-cc962075f0ab resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
13402024-11-19T02:16:37.003ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1827 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ca778746-f21a-4639-a074-cc962075f0ab response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
13412024-11-19T02:16:37.154ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1559 local_addr = [fd00:1122:3344:101::c]:60807 method = GET remote_addr = [fd00:1122:3344:101::d]:57844 req_id = c0df4a7d-690e-499d-997d-32112b42db14 response_code = 200 uri = /9f0b435f-0000-451e-9dbc-dcec71543c30
13422024-11-19T02:16:38.025ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4cda42aa-619a-43d6-8dce-4871155476d2 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
13432024-11-19T02:16:38.025ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4cda42aa-619a-43d6-8dce-4871155476d2 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
13442024-11-19T02:16:38.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2013 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4cda42aa-619a-43d6-8dce-4871155476d2 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
13452024-11-19T02:16:39.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a7679f4b-fd0d-487b-a1a2-7721b44f07d0 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
13462024-11-19T02:16:39.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a7679f4b-fd0d-487b-a1a2-7721b44f07d0 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
13472024-11-19T02:16:39.049ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2229 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a7679f4b-fd0d-487b-a1a2-7721b44f07d0 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
13482024-11-19T02:16:40.069ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 8bf22938-854a-4f00-a0fe-d74220c56609 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
13492024-11-19T02:16:40.070ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 8bf22938-854a-4f00-a0fe-d74220c56609 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
13502024-11-19T02:16:40.072ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2362 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 8bf22938-854a-4f00-a0fe-d74220c56609 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
13512024-11-19T02:16:41.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d1cb4764-a90e-410e-96b2-42620b230ebf roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
13522024-11-19T02:16:41.093ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d1cb4764-a90e-410e-96b2-42620b230ebf resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
13532024-11-19T02:16:41.095ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2578 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d1cb4764-a90e-410e-96b2-42620b230ebf response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
13542024-11-19T02:16:42.116ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3fe5a355-07d4-4063-8887-c8fc2bba98be roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
13552024-11-19T02:16:42.116ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3fe5a355-07d4-4063-8887-c8fc2bba98be resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
13562024-11-19T02:16:42.119ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2629 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3fe5a355-07d4-4063-8887-c8fc2bba98be response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
13572024-11-19T02:16:42.143ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:48845
13582024-11-19T02:16:42.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = ae7a412b-300a-4d1d-870b-7f2a60412817 roles = RoleSet { roles: {} } uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?sort_by=id_ascending
13592024-11-19T02:16:42.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = ae7a412b-300a-4d1d-870b-7f2a60412817 resource = Database result = Ok(()) uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?sort_by=id_ascending
13602024-11-19T02:16:42.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2945 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = ae7a412b-300a-4d1d-870b-7f2a60412817 response_code = 200 uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?sort_by=id_ascending
13612024-11-19T02:16:42.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = 82223a5b-cb0d-412c-b2e1-9521c441179e roles = RoleSet { roles: {} } uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZmU3NDgyNC0wYzA4LTQ4ZTEtYTc1NS1mYjEyM2U4ZGMxODEifX0%3D
13622024-11-19T02:16:42.147ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = 82223a5b-cb0d-412c-b2e1-9521c441179e resource = Database result = Ok(()) uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZmU3NDgyNC0wYzA4LTQ4ZTEtYTc1NS1mYjEyM2U4ZGMxODEifX0%3D
13632024-11-19T02:16:42.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1942 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = 82223a5b-cb0d-412c-b2e1-9521c441179e response_code = 200 uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZmU3NDgyNC0wYzA4LTQ4ZTEtYTc1NS1mYjEyM2U4ZGMxODEifX0%3D
13642024-11-19T02:16:43.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = fd43f8ef-8c47-4e7c-851a-54d358d4a941 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
13652024-11-19T02:16:43.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = fd43f8ef-8c47-4e7c-851a-54d358d4a941 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
13662024-11-19T02:16:43.142ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2471 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = fd43f8ef-8c47-4e7c-851a-54d358d4a941 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
13672024-11-19T02:16:44.162ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 18e40fb0-87a0-4d86-8c57-baff789fc1ba roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
13682024-11-19T02:16:44.163ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 18e40fb0-87a0-4d86-8c57-baff789fc1ba resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
13692024-11-19T02:16:44.164ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1699 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 18e40fb0-87a0-4d86-8c57-baff789fc1ba response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
13702024-11-19T02:16:45.184ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 28744f13-d598-4971-844f-a27464654519 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
13712024-11-19T02:16:45.184ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 28744f13-d598-4971-844f-a27464654519 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
13722024-11-19T02:16:45.186ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2201 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 28744f13-d598-4971-844f-a27464654519 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
13732024-11-19T02:16:45.721ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
13742024-11-19T02:16:45.721ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
13752024-11-19T02:16:45.721ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
13762024-11-19T02:16:45.721ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13772024-11-19T02:16:45.721ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
13782024-11-19T02:16:45.721ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
13792024-11-19T02:16:45.721ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-19 02:06:45.721786748 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
13802024-11-19T02:16:45.721ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
13812024-11-19T02:16:45.721ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
13822024-11-19T02:16:45.721ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
13832024-11-19T02:16:45.721ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
13842024-11-19T02:16:45.721ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
13852024-11-19T02:16:45.721ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
13862024-11-19T02:16:45.721ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13872024-11-19T02:16:45.721ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
13882024-11-19T02:16:45.721ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
13892024-11-19T02:16:45.721ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
13902024-11-19T02:16:45.721ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
13912024-11-19T02:16:45.721ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13922024-11-19T02:16:45.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13932024-11-19T02:16:45.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13942024-11-19T02:16:45.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
13952024-11-19T02:16:45.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
13962024-11-19T02:16:45.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13972024-11-19T02:16:45.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
13982024-11-19T02:16:45.722ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2d59cdb7-e3b1-4e94-afa3-f64f69928234.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a949a8d8-46c7-4423-b760-c03f98ccf638.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b190a9bf-d8b7-43c3-add4-e113c9b89870.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b190a9bf-d8b7-43c3-add4-e113c9b89870.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1303, tv_nsec: 509521913 } })
13992024-11-19T02:16:45.722ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("27d1a6ca-1b76-4956-aefa-e234c7d60cd0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("91bdcbd0-987b-49c4-8200-fc3e8f332b6b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("91bdcbd0-987b-49c4-8200-fc3e8f332b6b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1303, tv_nsec: 509677235 } })
14002024-11-19T02:16:45.722ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
14012024-11-19T02:16:45.722ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
14022024-11-19T02:16:45.722ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
14032024-11-19T02:16:45.722ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
14042024-11-19T02:16:45.722ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
14052024-11-19T02:16:45.722ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
14062024-11-19T02:16:45.722ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
14072024-11-19T02:16:45.722ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14082024-11-19T02:16:45.722ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
14092024-11-19T02:16:45.722ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
14102024-11-19T02:16:45.722ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
14112024-11-19T02:16:45.722ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14122024-11-19T02:16:45.722ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
14132024-11-19T02:16:45.722ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
14142024-11-19T02:16:45.722ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
14152024-11-19T02:16:45.722ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
14162024-11-19T02:16:45.722ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14172024-11-19T02:16:45.722ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14182024-11-19T02:16:45.722ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
14192024-11-19T02:16:45.722ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
14202024-11-19T02:16:45.722ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
14212024-11-19T02:16:45.722ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
14222024-11-19T02:16:45.722ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
14232024-11-19T02:16:45.722ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
14242024-11-19T02:16:45.722ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
14252024-11-19T02:16:45.722ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14262024-11-19T02:16:45.722ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
14272024-11-19T02:16:45.723ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14282024-11-19T02:16:45.723ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14292024-11-19T02:16:45.723ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
14302024-11-19T02:16:45.723ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
14312024-11-19T02:16:45.723ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
14322024-11-19T02:16:45.723ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
14332024-11-19T02:16:45.723ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
14342024-11-19T02:16:45.723ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
14352024-11-19T02:16:45.723ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
14362024-11-19T02:16:45.723ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
14372024-11-19T02:16:45.723ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
14382024-11-19T02:16:45.723ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14392024-11-19T02:16:45.723ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14402024-11-19T02:16:45.723ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
14412024-11-19T02:16:45.723ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115
14422024-11-19T02:16:45.723ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.03\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115"}
14432024-11-19T02:16:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
14442024-11-19T02:16:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
14452024-11-19T02:16:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
14462024-11-19T02:16:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14472024-11-19T02:16:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
14482024-11-19T02:16:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14492024-11-19T02:16:45.723ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
14502024-11-19T02:16:45.723ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.373216ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
14512024-11-19T02:16:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14522024-11-19T02:16:45.723ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
14532024-11-19T02:16:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14542024-11-19T02:16:45.723ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.483327ms iteration = 9 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
14552024-11-19T02:16:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
14562024-11-19T02:16:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14572024-11-19T02:16:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14582024-11-19T02:16:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
14592024-11-19T02:16:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14602024-11-19T02:16:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
14612024-11-19T02:16:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
14622024-11-19T02:16:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
14632024-11-19T02:16:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14642024-11-19T02:16:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14652024-11-19T02:16:45.723ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14662024-11-19T02:16:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14672024-11-19T02:16:45.724ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14682024-11-19T02:16:45.724ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14692024-11-19T02:16:45.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14702024-11-19T02:16:45.725ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-19 02:06:45.721786748 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
14712024-11-19T02:16:45.725ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.878965ms iteration = 8 status = {"expiration":"2024-11-19T02:06:45.721786748Z","pruned":[]}
14722024-11-19T02:16:45.725ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1303, tv_nsec: 513058664 } })
14732024-11-19T02:16:45.726ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
14742024-11-19T02:16:45.726ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
14752024-11-19T02:16:45.726ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14762024-11-19T02:16:45.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14772024-11-19T02:16:45.728ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1303, tv_nsec: 515554682 } })
14782024-11-19T02:16:45.728ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
14792024-11-19T02:16:45.729ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 7.289943ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
14802024-11-19T02:16:45.730ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14812024-11-19T02:16:45.730ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
14822024-11-19T02:16:45.730ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
14832024-11-19T02:16:45.730ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 7.753179ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
14842024-11-19T02:16:45.730ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 7.86768ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
14852024-11-19T02:16:45.731ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14862024-11-19T02:16:45.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14872024-11-19T02:16:45.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14882024-11-19T02:16:45.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
14892024-11-19T02:16:45.732ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14902024-11-19T02:16:45.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14912024-11-19T02:16:45.734ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14922024-11-19T02:16:45.734ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14932024-11-19T02:16:45.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14942024-11-19T02:16:45.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14952024-11-19T02:16:45.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14962024-11-19T02:16:45.736ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
14972024-11-19T02:16:45.736ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
14982024-11-19T02:16:45.736ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14992024-11-19T02:16:45.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15002024-11-19T02:16:45.737ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15012024-11-19T02:16:45.737ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15022024-11-19T02:16:45.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15032024-11-19T02:16:45.737ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
15042024-11-19T02:16:45.737ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
15052024-11-19T02:16:45.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
15062024-11-19T02:16:45.737ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15072024-11-19T02:16:45.739ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
15082024-11-19T02:16:45.739ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15092024-11-19T02:16:45.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15102024-11-19T02:16:45.740ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15112024-11-19T02:16:45.741ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15122024-11-19T02:16:45.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15132024-11-19T02:16:45.743ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
15142024-11-19T02:16:45.743ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
15152024-11-19T02:16:45.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
15162024-11-19T02:16:45.745ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15172024-11-19T02:16:45.746ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15182024-11-19T02:16:45.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15192024-11-19T02:16:45.747ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15202024-11-19T02:16:45.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15212024-11-19T02:16:45.748ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1303, tv_nsec: 535148036 } })
15222024-11-19T02:16:45.748ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
15232024-11-19T02:16:45.750ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
15242024-11-19T02:16:45.753ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15252024-11-19T02:16:45.753ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15262024-11-19T02:16:45.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15272024-11-19T02:16:45.754ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15282024-11-19T02:16:45.755ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
15292024-11-19T02:16:45.755ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15302024-11-19T02:16:45.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15312024-11-19T02:16:45.758ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
15322024-11-19T02:16:45.758ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15332024-11-19T02:16:45.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15342024-11-19T02:16:45.760ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 37.538309ms iteration = 15 status = {"errors":[],"records_set_to_done":[]}
15352024-11-19T02:16:45.760ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15362024-11-19T02:16:45.760ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
15372024-11-19T02:16:45.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
15382024-11-19T02:16:45.762ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15392024-11-19T02:16:45.762ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15402024-11-19T02:16:45.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15412024-11-19T02:16:45.763ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 40.953559ms iteration = 15 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
15422024-11-19T02:16:45.772ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 49.979172ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
15432024-11-19T02:16:45.784ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15442024-11-19T02:16:45.784ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15452024-11-19T02:16:45.787ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
15462024-11-19T02:16:45.787ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15472024-11-19T02:16:45.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15482024-11-19T02:16:45.788ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
15492024-11-19T02:16:45.788ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
15502024-11-19T02:16:45.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
15512024-11-19T02:16:45.790ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15522024-11-19T02:16:45.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15532024-11-19T02:16:45.793ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
15542024-11-19T02:16:45.794ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
15552024-11-19T02:16:45.794ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
15562024-11-19T02:16:45.794ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
15572024-11-19T02:16:45.794ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15582024-11-19T02:16:45.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
15592024-11-19T02:16:45.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15602024-11-19T02:16:45.794ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15612024-11-19T02:16:45.794ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15622024-11-19T02:16:45.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15632024-11-19T02:16:45.796ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15642024-11-19T02:16:45.798ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
15652024-11-19T02:16:45.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15662024-11-19T02:16:45.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15672024-11-19T02:16:45.799ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
15682024-11-19T02:16:45.799ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15692024-11-19T02:16:45.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15702024-11-19T02:16:45.800ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
15712024-11-19T02:16:45.800ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 77.454696ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
15722024-11-19T02:16:45.800ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
15732024-11-19T02:16:45.800ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
15742024-11-19T02:16:45.800ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 77.660469ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
15752024-11-19T02:16:45.801ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15762024-11-19T02:16:45.801ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
15772024-11-19T02:16:45.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15782024-11-19T02:16:45.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15792024-11-19T02:16:45.801ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 78.926743ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
15802024-11-19T02:16:45.820ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15812024-11-19T02:16:45.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15822024-11-19T02:16:45.822ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15832024-11-19T02:16:45.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15842024-11-19T02:16:45.824ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
15852024-11-19T02:16:45.824ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 101.404851ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
15862024-11-19T02:16:45.825ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
15872024-11-19T02:16:45.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
15882024-11-19T02:16:45.830ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 108.051987ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
15892024-11-19T02:16:45.834ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
15902024-11-19T02:16:45.834ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
15912024-11-19T02:16:45.834ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
15922024-11-19T02:16:45.834ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15932024-11-19T02:16:45.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15942024-11-19T02:16:45.835ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15952024-11-19T02:16:45.835ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15962024-11-19T02:16:45.835ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
15972024-11-19T02:16:45.835ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 113.159865ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
15982024-11-19T02:16:45.837ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
15992024-11-19T02:16:45.837ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 8c04fa4d-031f-4603-9b0e-246b45d39276 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
16002024-11-19T02:16:45.837ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16012024-11-19T02:16:45.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16022024-11-19T02:16:45.838ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 115.38338ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
16032024-11-19T02:16:45.838ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
16042024-11-19T02:16:45.838ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16052024-11-19T02:16:45.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16062024-11-19T02:16:45.843ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16072024-11-19T02:16:45.845ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
16082024-11-19T02:16:45.845ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16092024-11-19T02:16:45.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16102024-11-19T02:16:45.849ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
16112024-11-19T02:16:45.852ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
16122024-11-19T02:16:45.854ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16132024-11-19T02:16:45.855ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16142024-11-19T02:16:45.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16152024-11-19T02:16:45.856ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: ffe74824-0c08-48e1-a755-fb123e8dc181, lookup_type: ById(ffe74824-0c08-48e1-a755-fb123e8dc181) } result = Ok(())
16162024-11-19T02:16:45.856ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16172024-11-19T02:16:45.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16182024-11-19T02:16:45.876ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
16192024-11-19T02:16:45.876ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16202024-11-19T02:16:45.876ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c54ccc6d-db6a-47d8-ba5d-0beb84e1ae4e", "content-length": "26", "date": "Tue, 19 Nov 2024 02:16:45 GMT"} })
16212024-11-19T02:16:45.876ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16222024-11-19T02:16:45.877ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
16232024-11-19T02:16:45.879ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 156.732354ms iteration = 18 status = {"physical_disks_added":0}
16242024-11-19T02:16:45.912ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
16252024-11-19T02:16:45.912ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16262024-11-19T02:16:45.912ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "89635239-f7e4-4c2a-aa48-6297937d9626", "content-length": "26", "date": "Tue, 19 Nov 2024 02:16:45 GMT"} })
16272024-11-19T02:16:45.912ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16282024-11-19T02:16:45.915ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
16292024-11-19T02:16:45.920ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 zone_address = fd00:1122:3344:101::2
16302024-11-19T02:16:45.920ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16312024-11-19T02:16:45.920ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e8a93e5-36d1-4344-8497-a3e474dc5b40", "content-length": "26", "date": "Tue, 19 Nov 2024 02:16:45 GMT"} })
16322024-11-19T02:16:45.920ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16332024-11-19T02:16:45.922ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
16342024-11-19T02:16:45.927ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
16352024-11-19T02:16:45.927ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 204.911756ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
16362024-11-19T02:16:46.011ZINFOnexus (BackgroundTasks): VPC route manager sled ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
16372024-11-19T02:16:46.012ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16382024-11-19T02:16:46.012ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc80b232-4e35-4621-94f7-d9e3ac1fc034", "content-length": "372", "date": "Tue, 19 Nov 2024 02:16:46 GMT"} })
16392024-11-19T02:16:46.012ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16402024-11-19T02:16:46.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16412024-11-19T02:16:46.014ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16422024-11-19T02:16:46.016ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 293.53804ms iteration = 15 status = 0
16432024-11-19T02:16:46.019ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
16442024-11-19T02:16:46.019ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16452024-11-19T02:16:46.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16462024-11-19T02:16:46.021ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
16472024-11-19T02:16:46.022ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "0a101d37-deda-40f2-9a4f-a4d7509ea73a", "date": "Tue, 19 Nov 2024 02:16:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
16482024-11-19T02:16:46.022ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
16492024-11-19T02:16:46.022ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 8c04fa4d-031f-4603-9b0e-246b45d39276 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
16502024-11-19T02:16:46.022ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
16512024-11-19T02:16:46.022ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-19 02:10:27.714570 UTC dns_group = internal generation = 1
16522024-11-19T02:16:46.022ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 300.593941ms iteration = 9 status = {"generation":1}
16532024-11-19T02:16:46.024ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "499a6a5b-a349-43e6-aa71-0248cd2b8f7c", "date": "Tue, 19 Nov 2024 02:16:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
16542024-11-19T02:16:46.024ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
16552024-11-19T02:16:46.027ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
16562024-11-19T02:16:46.027ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 305.390066ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
16572024-11-19T02:16:46.044ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
16582024-11-19T02:16:46.046ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 325.149782ms iteration = 15 status = {}
16592024-11-19T02:16:46.068ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-19T02:09:41.910054Z, time_modified: 2024-11-19T02:09:41.910054Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 78638afa-e975-44a9-b764-0afec18d156f, db_silo: Silo { identity: SiloIdentity { id: 78638afa-e975-44a9-b764-0afec18d156f, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-19T02:10:28.623188Z, time_modified: 2024-11-19T02:10:28.623188Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "fe94815f3f5502a309deafc95cd58d4fe61e984b7bd8ad11309589068beb64f5" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 78638afa-e975-44a9-b764-0afec18d156f, db_silo: Silo { identity: SiloIdentity { id: 78638afa-e975-44a9-b764-0afec18d156f, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-19T02:10:28.623188Z, time_modified: 2024-11-19T02:10:28.623188Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "fe94815f3f5502a309deafc95cd58d4fe61e984b7bd8ad11309589068beb64f5" }] }) }
16602024-11-19T02:16:46.068ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 346.581487ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"78638afa-e975-44a9-b764-0afec18d156f","tls_certs":["fe94815f3f5502a309deafc95cd58d4fe61e984b7bd8ad11309589068beb64f5"]}},"default_endpoint":{"silo_id":"78638afa-e975-44a9-b764-0afec18d156f","tls_certs":["fe94815f3f5502a309deafc95cd58d4fe61e984b7bd8ad11309589068beb64f5"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
16612024-11-19T02:16:46.069ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
16622024-11-19T02:16:46.070ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "8daf458c-5a20-4a37-b82b-caef7b6eab55", "content-length": "1", "date": "Tue, 19 Nov 2024 02:16:45 GMT"} })
16632024-11-19T02:16:46.072ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
16642024-11-19T02:16:46.072ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = af79c7eb-bc4d-42f8-9217-8b35affeeebb dns_zone_name = oxide.test found_so_far = 0 version = 2
16652024-11-19T02:16:46.072ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16662024-11-19T02:16:46.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16672024-11-19T02:16:46.073ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
16682024-11-19T02:16:46.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
16692024-11-19T02:16:46.074ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16702024-11-19T02:16:46.076ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 354.412287ms iteration = 15 status = null
16712024-11-19T02:16:46.078ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
16722024-11-19T02:16:46.078ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16732024-11-19T02:16:46.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16742024-11-19T02:16:46.084ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = af79c7eb-bc4d-42f8-9217-8b35affeeebb dns_zone_name = oxide.test found_so_far = 1 version = 2
16752024-11-19T02:16:46.084ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
16762024-11-19T02:16:46.084ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-19 02:10:28.769117 UTC dns_group = external generation = 2
16772024-11-19T02:16:46.084ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 362.372757ms iteration = 9 status = {"generation":2}
16782024-11-19T02:16:46.108ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
16792024-11-19T02:16:46.108ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
16802024-11-19T02:16:46.109ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "2ebfcbbf-5bde-4cc9-9146-dd755d361705", "date": "Tue, 19 Nov 2024 02:16:46 GMT"} })
16812024-11-19T02:16:46.109ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16822024-11-19T02:16:46.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16832024-11-19T02:16:46.113ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16842024-11-19T02:16:46.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16852024-11-19T02:16:46.121ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16862024-11-19T02:16:46.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16872024-11-19T02:16:46.125ZINFOnexus (BackgroundTasks): VPC route manager sled ffe74824-0c08-48e1-a755-fb123e8dc181 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
16882024-11-19T02:16:46.125ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16892024-11-19T02:16:46.126ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "9725aa82-2486-4c5e-a0ba-6eb6153fbcf6", "date": "Tue, 19 Nov 2024 02:16:46 GMT"} })
16902024-11-19T02:16:46.128ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 406.195779ms iteration = 16 status = {}
16912024-11-19T02:16:46.152ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
16922024-11-19T02:16:46.153ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "d2491f41-8665-4c2c-af3b-1c28ce6caede", "date": "Tue, 19 Nov 2024 02:16:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
16932024-11-19T02:16:46.153ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
16942024-11-19T02:16:46.154ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "08923a1f-5059-48d1-9d44-6592783d1f76", "date": "Tue, 19 Nov 2024 02:16:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
16952024-11-19T02:16:46.154ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
16962024-11-19T02:16:46.156ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "40659be8-899e-4c36-8918-cb86e38e38d0", "date": "Tue, 19 Nov 2024 02:16:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
16972024-11-19T02:16:46.156ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
16982024-11-19T02:16:46.158ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
16992024-11-19T02:16:46.158ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 436.911421ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
17002024-11-19T02:16:46.171ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17012024-11-19T02:16:46.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17022024-11-19T02:16:46.208ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3e866551-f8c5-4ccc-a0d2-249b2c0aabb6 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
17032024-11-19T02:16:46.208ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17042024-11-19T02:16:46.208ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3e866551-f8c5-4ccc-a0d2-249b2c0aabb6 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
17052024-11-19T02:16:46.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17062024-11-19T02:16:46.210ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2342 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3e866551-f8c5-4ccc-a0d2-249b2c0aabb6 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
17072024-11-19T02:16:46.211ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 20bc3881-e2ee-4d8d-b84b-b0c1e478721f, rack_id: a894e92e-d765-4f15-b6b7-cb9ca46d1860, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8597d802-6d4d-4493-88de-333a1f340c20) } rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0
17082024-11-19T02:16:46.211ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17092024-11-19T02:16:46.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17102024-11-19T02:16:46.213ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17112024-11-19T02:16:46.215ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
17122024-11-19T02:16:46.215ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17132024-11-19T02:16:46.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17142024-11-19T02:16:46.217ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17152024-11-19T02:16:46.219ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
17162024-11-19T02:16:46.219ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17172024-11-19T02:16:46.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17182024-11-19T02:16:46.223ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
17192024-11-19T02:16:46.223ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "afaa7edf-5a43-48fb-9f61-b1015abbce3d", "content-length": "134", "date": "Tue, 19 Nov 2024 02:16:45 GMT"} })
17202024-11-19T02:16:46.223ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
17212024-11-19T02:16:46.223ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8597d802-6d4d-4493-88de-333a1f340c20
17222024-11-19T02:16:46.223ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
17232024-11-19T02:16:46.223ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
17242024-11-19T02:16:46.223ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17252024-11-19T02:16:46.223ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17262024-11-19T02:16:46.223ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17272024-11-19T02:16:46.223ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
17282024-11-19T02:16:46.223ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17292024-11-19T02:16:46.223ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
17302024-11-19T02:16:46.224ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
17312024-11-19T02:16:46.224ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17322024-11-19T02:16:46.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17332024-11-19T02:16:46.226ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
17342024-11-19T02:16:46.226ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b0799eb2-717f-4074-9bcc-87e4ed97c63b", "content-length": "2", "date": "Tue, 19 Nov 2024 02:16:45 GMT"} })
17352024-11-19T02:16:46.226ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
17362024-11-19T02:16:46.226ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7bea5bd5-14cf-4c25-9eb5-931e487dbc24", "content-length": "52", "date": "Tue, 19 Nov 2024 02:16:45 GMT"} })
17372024-11-19T02:16:46.226ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0
17382024-11-19T02:16:46.226ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
17392024-11-19T02:16:46.312ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
17402024-11-19T02:16:46.349ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "c4ce2e89-924b-4ec8-ac86-b68a2f5a9ea0", "date": "Tue, 19 Nov 2024 02:16:46 GMT"} })
17412024-11-19T02:16:46.349ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch = Switch0
17422024-11-19T02:16:46.349ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
17432024-11-19T02:16:46.349ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "43d39439-42a1-4418-9092-a7533611e676", "content-length": "682", "date": "Tue, 19 Nov 2024 02:16:46 GMT"} })
17442024-11-19T02:16:46.349ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17452024-11-19T02:16:46.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17462024-11-19T02:16:46.350ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "28180170-3e99-4885-b888-8a0c9da06a72", "content-length": "691", "date": "Tue, 19 Nov 2024 02:16:46 GMT"} })
17472024-11-19T02:16:46.350ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
17482024-11-19T02:16:46.350ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
17492024-11-19T02:16:46.350ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
17502024-11-19T02:16:46.351ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 629.184512ms iteration = 15 status = {}
17512024-11-19T02:16:46.353ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17522024-11-19T02:16:46.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17532024-11-19T02:16:46.356ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17542024-11-19T02:16:46.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17552024-11-19T02:16:46.359ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17562024-11-19T02:16:46.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17572024-11-19T02:16:46.368ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 646.190606ms iteration = 15 status = {}
17582024-11-19T02:16:46.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = 6adaff7a-d5ce-453a-a52e-1f0f1b9c9f86 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
17592024-11-19T02:16:46.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = 6adaff7a-d5ce-453a-a52e-1f0f1b9c9f86 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
17602024-11-19T02:16:46.771ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3585 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = 6adaff7a-d5ce-453a-a52e-1f0f1b9c9f86 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
17612024-11-19T02:16:47.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3fb8301d-38a2-4fdb-a8a8-4dc80843bcc5 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
17622024-11-19T02:16:47.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3fb8301d-38a2-4fdb-a8a8-4dc80843bcc5 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
17632024-11-19T02:16:47.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2319 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3fb8301d-38a2-4fdb-a8a8-4dc80843bcc5 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
17642024-11-19T02:16:48.375ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ab46b86d-e633-414c-827b-ccc14e097076 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
17652024-11-19T02:16:48.375ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ab46b86d-e633-414c-827b-ccc14e097076 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
17662024-11-19T02:16:48.377ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2266 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ab46b86d-e633-414c-827b-ccc14e097076 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
17672024-11-19T02:16:49.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 23f3f0a2-93cb-4fc7-beeb-cffe4f2354c6 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
17682024-11-19T02:16:49.398ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 23f3f0a2-93cb-4fc7-beeb-cffe4f2354c6 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
17692024-11-19T02:16:49.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2209 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 23f3f0a2-93cb-4fc7-beeb-cffe4f2354c6 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
17702024-11-19T02:16:50.421ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 56500b72-34e3-48aa-8e50-f4bf46d11b26 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
17712024-11-19T02:16:50.421ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 56500b72-34e3-48aa-8e50-f4bf46d11b26 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
17722024-11-19T02:16:50.423ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2324 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 56500b72-34e3-48aa-8e50-f4bf46d11b26 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
17732024-11-19T02:16:51.442ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0b487ba4-8086-447a-a7f0-2ba9eb37a194 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
17742024-11-19T02:16:51.443ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0b487ba4-8086-447a-a7f0-2ba9eb37a194 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
17752024-11-19T02:16:51.445ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2388 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0b487ba4-8086-447a-a7f0-2ba9eb37a194 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
17762024-11-19T02:16:52.151ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1526 local_addr = [fd00:1122:3344:101::c]:60807 method = GET remote_addr = [fd00:1122:3344:101::d]:57844 req_id = 7cbd8383-9d6b-4eb9-a593-df9be7633377 response_code = 200 uri = /9f0b435f-0000-451e-9dbc-dcec71543c30
17772024-11-19T02:16:52.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0aeec38a-b937-472d-890d-d410fd923e9a roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
17782024-11-19T02:16:52.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0aeec38a-b937-472d-890d-d410fd923e9a resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
17792024-11-19T02:16:52.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2043 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0aeec38a-b937-472d-890d-d410fd923e9a response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
17802024-11-19T02:16:53.492ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 32173854-cb11-4d85-8b8a-1ba1c40ec09e roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
17812024-11-19T02:16:53.492ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 32173854-cb11-4d85-8b8a-1ba1c40ec09e resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
17822024-11-19T02:16:53.494ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2547 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 32173854-cb11-4d85-8b8a-1ba1c40ec09e response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
17832024-11-19T02:16:54.516ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 2f43b50b-595d-47ce-88b8-bea22767cae6 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
17842024-11-19T02:16:54.516ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 2f43b50b-595d-47ce-88b8-bea22767cae6 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
17852024-11-19T02:16:54.518ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2271 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 2f43b50b-595d-47ce-88b8-bea22767cae6 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
17862024-11-19T02:16:55.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0c8cdb8b-1e21-4833-a078-6a0e354fa312 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
17872024-11-19T02:16:55.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0c8cdb8b-1e21-4833-a078-6a0e354fa312 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
17882024-11-19T02:16:55.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2577 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0c8cdb8b-1e21-4833-a078-6a0e354fa312 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
17892024-11-19T02:16:55.723ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
17902024-11-19T02:16:55.723ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
17912024-11-19T02:16:55.723ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17922024-11-19T02:16:55.723ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17932024-11-19T02:16:55.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17942024-11-19T02:16:55.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17952024-11-19T02:16:55.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17962024-11-19T02:16:55.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17972024-11-19T02:16:55.753ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.77427ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17982024-11-19T02:16:55.754ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17992024-11-19T02:16:55.756ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18002024-11-19T02:16:55.756ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18012024-11-19T02:16:55.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18022024-11-19T02:16:55.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18032024-11-19T02:16:55.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18042024-11-19T02:16:55.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18052024-11-19T02:16:55.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
18062024-11-19T02:16:55.763ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18072024-11-19T02:16:55.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18082024-11-19T02:16:55.774ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
18092024-11-19T02:16:55.774ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 51.401898ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
18102024-11-19T02:16:56.562ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 48ec02fd-f6ac-453e-b060-9fa714c285a4 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
18112024-11-19T02:16:56.563ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 48ec02fd-f6ac-453e-b060-9fa714c285a4 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
18122024-11-19T02:16:56.564ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1786 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 48ec02fd-f6ac-453e-b060-9fa714c285a4 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
18132024-11-19T02:16:57.142ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = dddb3adb-f033-417d-bfe2-162359dd0673 roles = RoleSet { roles: {} } uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?sort_by=id_ascending
18142024-11-19T02:16:57.142ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = dddb3adb-f033-417d-bfe2-162359dd0673 resource = Database result = Ok(()) uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?sort_by=id_ascending
18152024-11-19T02:16:57.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3127 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = dddb3adb-f033-417d-bfe2-162359dd0673 response_code = 200 uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?sort_by=id_ascending
18162024-11-19T02:16:57.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = b9f3a9b9-7095-41c4-98e8-c19d20d70dde roles = RoleSet { roles: {} } uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZmU3NDgyNC0wYzA4LTQ4ZTEtYTc1NS1mYjEyM2U4ZGMxODEifX0%3D
18172024-11-19T02:16:57.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = b9f3a9b9-7095-41c4-98e8-c19d20d70dde resource = Database result = Ok(()) uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZmU3NDgyNC0wYzA4LTQ4ZTEtYTc1NS1mYjEyM2U4ZGMxODEifX0%3D
18182024-11-19T02:16:57.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2335 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = b9f3a9b9-7095-41c4-98e8-c19d20d70dde response_code = 200 uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZmU3NDgyNC0wYzA4LTQ4ZTEtYTc1NS1mYjEyM2U4ZGMxODEifX0%3D
18192024-11-19T02:16:57.584ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6245db48-7572-4600-a59e-e3cb3bb99064 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
18202024-11-19T02:16:57.585ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6245db48-7572-4600-a59e-e3cb3bb99064 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
18212024-11-19T02:16:57.586ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2084 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6245db48-7572-4600-a59e-e3cb3bb99064 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
18222024-11-19T02:16:58.606ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 98980e5c-2ed8-4152-bed2-dd1cd2b0bb7d roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
18232024-11-19T02:16:58.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 98980e5c-2ed8-4152-bed2-dd1cd2b0bb7d resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
18242024-11-19T02:16:58.609ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2383 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 98980e5c-2ed8-4152-bed2-dd1cd2b0bb7d response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
18252024-11-19T02:16:59.630ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 38c5ac85-2f5c-4213-8145-684ef7e9fade roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
18262024-11-19T02:16:59.630ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 38c5ac85-2f5c-4213-8145-684ef7e9fade resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
18272024-11-19T02:16:59.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2507 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 38c5ac85-2f5c-4213-8145-684ef7e9fade response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
18282024-11-19T02:17:00.653ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ca30fedc-05d2-46dc-8947-41a97812ce76 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
18292024-11-19T02:17:00.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ca30fedc-05d2-46dc-8947-41a97812ce76 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
18302024-11-19T02:17:00.655ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1837 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ca30fedc-05d2-46dc-8947-41a97812ce76 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
18312024-11-19T02:17:01.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9d803428-f751-48de-b907-ba45911666b1 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
18322024-11-19T02:17:01.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9d803428-f751-48de-b907-ba45911666b1 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
18332024-11-19T02:17:01.678ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1827 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9d803428-f751-48de-b907-ba45911666b1 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
18342024-11-19T02:17:02.699ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 53d6d35d-7a6a-4180-a1c3-081c59fb1d4b roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
18352024-11-19T02:17:02.699ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 53d6d35d-7a6a-4180-a1c3-081c59fb1d4b resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
18362024-11-19T02:17:02.701ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2173 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 53d6d35d-7a6a-4180-a1c3-081c59fb1d4b response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
18372024-11-19T02:17:03.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 407ec5fc-e0e2-4222-a8d5-dbd48e070e2f roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
18382024-11-19T02:17:03.722ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 407ec5fc-e0e2-4222-a8d5-dbd48e070e2f resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
18392024-11-19T02:17:03.723ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1914 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 407ec5fc-e0e2-4222-a8d5-dbd48e070e2f response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
18402024-11-19T02:17:04.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = f68c8004-7cf3-4277-aa4a-7f1bcaa62fde roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
18412024-11-19T02:17:04.745ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = f68c8004-7cf3-4277-aa4a-7f1bcaa62fde resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
18422024-11-19T02:17:04.747ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2163 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = f68c8004-7cf3-4277-aa4a-7f1bcaa62fde response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
18432024-11-19T02:17:05.723ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
18442024-11-19T02:17:05.723ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18452024-11-19T02:17:05.723ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
18462024-11-19T02:17:05.723ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18472024-11-19T02:17:05.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18482024-11-19T02:17:05.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18492024-11-19T02:17:05.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18502024-11-19T02:17:05.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18512024-11-19T02:17:05.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18522024-11-19T02:17:05.727ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.409571ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18532024-11-19T02:17:05.728ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18542024-11-19T02:17:05.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18552024-11-19T02:17:05.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18562024-11-19T02:17:05.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18572024-11-19T02:17:05.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18582024-11-19T02:17:05.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18592024-11-19T02:17:05.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
18602024-11-19T02:17:05.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18612024-11-19T02:17:05.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18622024-11-19T02:17:05.747ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
18632024-11-19T02:17:05.747ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.43058ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
18642024-11-19T02:17:05.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 06a74f0b-90bb-4dfc-b6b6-727c1aa7eaeb roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
18652024-11-19T02:17:05.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 06a74f0b-90bb-4dfc-b6b6-727c1aa7eaeb resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
18662024-11-19T02:17:05.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1745 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 06a74f0b-90bb-4dfc-b6b6-727c1aa7eaeb response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
18672024-11-19T02:17:06.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a2ded332-8b91-412c-b1de-8fc04a69f231 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
18682024-11-19T02:17:06.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a2ded332-8b91-412c-b1de-8fc04a69f231 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
18692024-11-19T02:17:06.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1854 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a2ded332-8b91-412c-b1de-8fc04a69f231 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
18702024-11-19T02:17:07.151ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1650 local_addr = [fd00:1122:3344:101::c]:60807 method = GET remote_addr = [fd00:1122:3344:101::d]:57844 req_id = c5f24992-9568-4275-be35-c53bc9e5a0ac response_code = 200 uri = /9f0b435f-0000-451e-9dbc-dcec71543c30
18712024-11-19T02:17:07.813ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 660bfbc5-5c3d-407c-a3e1-55448db2a6a1 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
18722024-11-19T02:17:07.813ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 660bfbc5-5c3d-407c-a3e1-55448db2a6a1 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
18732024-11-19T02:17:07.815ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2124 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 660bfbc5-5c3d-407c-a3e1-55448db2a6a1 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
18742024-11-19T02:17:08.836ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 17d7c027-bc83-4953-8bab-3b54c516f9c1 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
18752024-11-19T02:17:08.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 17d7c027-bc83-4953-8bab-3b54c516f9c1 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
18762024-11-19T02:17:08.839ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2070 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 17d7c027-bc83-4953-8bab-3b54c516f9c1 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
18772024-11-19T02:17:09.860ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 2189fb67-af46-4af0-8556-14f0b6803d9b roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
18782024-11-19T02:17:09.860ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 2189fb67-af46-4af0-8556-14f0b6803d9b resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
18792024-11-19T02:17:09.862ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2404 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 2189fb67-af46-4af0-8556-14f0b6803d9b response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
18802024-11-19T02:17:10.883ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0d4d839b-5dc5-49f3-ab97-91eb436cf480 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
18812024-11-19T02:17:10.883ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0d4d839b-5dc5-49f3-ab97-91eb436cf480 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
18822024-11-19T02:17:10.884ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1772 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0d4d839b-5dc5-49f3-ab97-91eb436cf480 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
18832024-11-19T02:17:11.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 09fba18d-4ac3-448c-9b0b-916a1d1af9ea roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
18842024-11-19T02:17:11.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 09fba18d-4ac3-448c-9b0b-916a1d1af9ea resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
18852024-11-19T02:17:11.908ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1826 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 09fba18d-4ac3-448c-9b0b-916a1d1af9ea response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
18862024-11-19T02:17:12.928ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 62b89774-5dbc-4aae-b02d-4f1ad1d85cd5 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
18872024-11-19T02:17:12.929ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 62b89774-5dbc-4aae-b02d-4f1ad1d85cd5 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
18882024-11-19T02:17:12.930ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2083 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 62b89774-5dbc-4aae-b02d-4f1ad1d85cd5 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
18892024-11-19T02:17:13.951ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b65061e1-8d5f-4a26-8e09-2e7dfb816c29 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
18902024-11-19T02:17:13.952ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b65061e1-8d5f-4a26-8e09-2e7dfb816c29 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
18912024-11-19T02:17:13.953ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2356 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b65061e1-8d5f-4a26-8e09-2e7dfb816c29 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
18922024-11-19T02:17:14.288ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:57337
18932024-11-19T02:17:14.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:57337 req_id = 576bce63-cec4-4e37-9148-cce354c0631d roles = RoleSet { roles: {} } uri = /metrics/producers
18942024-11-19T02:17:14.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:57337 req_id = 576bce63-cec4-4e37-9148-cce354c0631d resource = Database result = Ok(()) uri = /metrics/producers
18952024-11-19T02:17:14.299ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:45228
18962024-11-19T02:17:14.299ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45228 req_id = f0defe78-2967-4f0c-821b-1e4768744b5e roles = RoleSet { roles: {} } uri = /metrics/producers
18972024-11-19T02:17:14.299ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45228 req_id = f0defe78-2967-4f0c-821b-1e4768744b5e resource = Database result = Ok(()) uri = /metrics/producers
18982024-11-19T02:17:14.333ZINFOnexus: assigned collector to new producer collector_id = 3980dd20-a3be-40d3-b9e5-094b8ed4b785 file = nexus/src/app/oximeter.rs:76 producer_id = 4531e85d-d56a-4e09-b4e5-16020bc21701
18992024-11-19T02:17:14.333ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45106 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:57337 req_id = 576bce63-cec4-4e37-9148-cce354c0631d response_code = 201 uri = /metrics/producers
19002024-11-19T02:17:14.344ZINFOnexus: assigned collector to new producer collector_id = 3980dd20-a3be-40d3-b9e5-094b8ed4b785 file = nexus/src/app/oximeter.rs:76 producer_id = ffe74824-0c08-48e1-a755-fb123e8dc181
19012024-11-19T02:17:14.344ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44439 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45228 req_id = f0defe78-2967-4f0c-821b-1e4768744b5e response_code = 201 uri = /metrics/producers
19022024-11-19T02:17:14.956ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:57247
19032024-11-19T02:17:14.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:57247 req_id = 55f8d27a-6979-4e59-805a-7f37c7b2352e roles = RoleSet { roles: {} } uri = /metrics/producers
19042024-11-19T02:17:14.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:57247 req_id = 55f8d27a-6979-4e59-805a-7f37c7b2352e resource = Database result = Ok(()) uri = /metrics/producers
19052024-11-19T02:17:14.973ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = cc3c3f95-969f-40c9-8f04-d23483fffe2c roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
19062024-11-19T02:17:14.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = cc3c3f95-969f-40c9-8f04-d23483fffe2c resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
19072024-11-19T02:17:14.975ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1605 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = cc3c3f95-969f-40c9-8f04-d23483fffe2c response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
19082024-11-19T02:17:14.994ZINFOnexus: assigned collector to new producer collector_id = 3980dd20-a3be-40d3-b9e5-094b8ed4b785 file = nexus/src/app/oximeter.rs:76 producer_id = cd87c155-df14-4737-bbdc-04963164d701
19092024-11-19T02:17:14.994ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38563 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:57247 req_id = 55f8d27a-6979-4e59-805a-7f37c7b2352e response_code = 201 uri = /metrics/producers
19102024-11-19T02:17:15.721ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
19112024-11-19T02:17:15.721ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
19122024-11-19T02:17:15.721ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
19132024-11-19T02:17:15.721ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
19142024-11-19T02:17:15.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
19152024-11-19T02:17:15.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
19162024-11-19T02:17:15.722ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
19172024-11-19T02:17:15.722ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
19182024-11-19T02:17:15.722ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19192024-11-19T02:17:15.722ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
19202024-11-19T02:17:15.722ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
19212024-11-19T02:17:15.722ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
19222024-11-19T02:17:15.722ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
19232024-11-19T02:17:15.722ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
19242024-11-19T02:17:15.722ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19252024-11-19T02:17:15.722ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19262024-11-19T02:17:15.722ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
19272024-11-19T02:17:15.722ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
19282024-11-19T02:17:15.722ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
19292024-11-19T02:17:15.722ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
19302024-11-19T02:17:15.722ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
19312024-11-19T02:17:15.722ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19322024-11-19T02:17:15.722ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
19332024-11-19T02:17:15.722ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
19342024-11-19T02:17:15.722ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19352024-11-19T02:17:15.722ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
19362024-11-19T02:17:15.722ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
19372024-11-19T02:17:15.722ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
19382024-11-19T02:17:15.722ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
19392024-11-19T02:17:15.722ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19402024-11-19T02:17:15.722ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
19412024-11-19T02:17:15.722ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
19422024-11-19T02:17:15.722ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
19432024-11-19T02:17:15.722ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19442024-11-19T02:17:15.722ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19452024-11-19T02:17:15.722ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
19462024-11-19T02:17:15.722ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19472024-11-19T02:17:15.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
19482024-11-19T02:17:15.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19492024-11-19T02:17:15.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19502024-11-19T02:17:15.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19512024-11-19T02:17:15.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
19522024-11-19T02:17:15.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19532024-11-19T02:17:15.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
19542024-11-19T02:17:15.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19552024-11-19T02:17:15.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
19562024-11-19T02:17:15.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19572024-11-19T02:17:15.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19582024-11-19T02:17:15.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
19592024-11-19T02:17:15.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19602024-11-19T02:17:15.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19612024-11-19T02:17:15.725ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1333, tv_nsec: 512052572 } })
19622024-11-19T02:17:15.725ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1333, tv_nsec: 512126903 } })
19632024-11-19T02:17:15.725ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
19642024-11-19T02:17:15.725ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
19652024-11-19T02:17:15.725ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19662024-11-19T02:17:15.726ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19672024-11-19T02:17:15.726ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.811734ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
19682024-11-19T02:17:15.728ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
19692024-11-19T02:17:15.728ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19702024-11-19T02:17:15.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19712024-11-19T02:17:15.729ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
19722024-11-19T02:17:15.729ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19732024-11-19T02:17:15.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19742024-11-19T02:17:15.731ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19752024-11-19T02:17:15.732ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19762024-11-19T02:17:15.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
19772024-11-19T02:17:15.733ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
19782024-11-19T02:17:15.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
19792024-11-19T02:17:15.737ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
19802024-11-19T02:17:15.737ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19812024-11-19T02:17:15.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19822024-11-19T02:17:15.739ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19832024-11-19T02:17:15.740ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19842024-11-19T02:17:15.741ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
19852024-11-19T02:17:15.741ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19862024-11-19T02:17:15.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19872024-11-19T02:17:15.742ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
19882024-11-19T02:17:15.742ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19892024-11-19T02:17:15.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19902024-11-19T02:17:15.743ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19912024-11-19T02:17:15.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19922024-11-19T02:17:15.744ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1333, tv_nsec: 531074600 } })
19932024-11-19T02:17:15.744ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
19942024-11-19T02:17:15.744ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19952024-11-19T02:17:15.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19962024-11-19T02:17:15.760ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 37.736832ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
19972024-11-19T02:17:15.760ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19982024-11-19T02:17:15.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19992024-11-19T02:17:15.765ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
20002024-11-19T02:17:15.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
20012024-11-19T02:17:15.767ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
20022024-11-19T02:17:15.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
20032024-11-19T02:17:15.769ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
20042024-11-19T02:17:15.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
20052024-11-19T02:17:15.770ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20062024-11-19T02:17:15.770ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
20072024-11-19T02:17:15.770ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
20082024-11-19T02:17:15.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
20092024-11-19T02:17:15.772ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 50.187845ms iteration = 16 status = {"errors":[],"records_set_to_done":[]}
20102024-11-19T02:17:15.773ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20112024-11-19T02:17:15.773ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
20122024-11-19T02:17:15.773ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
20132024-11-19T02:17:15.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
20142024-11-19T02:17:15.781ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20152024-11-19T02:17:15.781ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20162024-11-19T02:17:15.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20172024-11-19T02:17:15.783ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.398141ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
20182024-11-19T02:17:15.784ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20192024-11-19T02:17:15.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20202024-11-19T02:17:15.785ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
20212024-11-19T02:17:15.785ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20222024-11-19T02:17:15.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20232024-11-19T02:17:15.786ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20242024-11-19T02:17:15.787ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20252024-11-19T02:17:15.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20262024-11-19T02:17:15.787ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20272024-11-19T02:17:15.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20282024-11-19T02:17:15.788ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
20292024-11-19T02:17:15.788ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 66.132817ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
20302024-11-19T02:17:15.789ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
20312024-11-19T02:17:15.789ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20322024-11-19T02:17:15.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20332024-11-19T02:17:15.790ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20342024-11-19T02:17:15.791ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20352024-11-19T02:17:15.794ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: ffe74824-0c08-48e1-a755-fb123e8dc181, lookup_type: ById(ffe74824-0c08-48e1-a755-fb123e8dc181) } result = Ok(())
20362024-11-19T02:17:15.794ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20372024-11-19T02:17:15.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20382024-11-19T02:17:15.794ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
20392024-11-19T02:17:15.794ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20402024-11-19T02:17:15.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20412024-11-19T02:17:15.796ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 74.000167ms iteration = 16 status = 0
20422024-11-19T02:17:15.806ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 83.585267ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
20432024-11-19T02:17:15.806ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20442024-11-19T02:17:15.806ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
20452024-11-19T02:17:15.806ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 83.661538ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
20462024-11-19T02:17:15.808ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
20472024-11-19T02:17:15.808ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
20482024-11-19T02:17:15.808ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f235436-39cb-4c00-b05c-2a193a3c3768", "content-length": "26", "date": "Tue, 19 Nov 2024 02:17:15 GMT"} })
20492024-11-19T02:17:15.808ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
20502024-11-19T02:17:15.810ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
20512024-11-19T02:17:15.810ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
20522024-11-19T02:17:15.810ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 88.032528ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
20532024-11-19T02:17:15.810ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 88.15542ms iteration = 16 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
20542024-11-19T02:17:15.811ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 88.417972ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
20552024-11-19T02:17:15.819ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
20562024-11-19T02:17:15.819ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
20572024-11-19T02:17:15.820ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f815a956-0064-463b-b7ed-97eadb5cad49", "content-length": "26", "date": "Tue, 19 Nov 2024 02:17:15 GMT"} })
20582024-11-19T02:17:15.820ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
20592024-11-19T02:17:15.821ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
20602024-11-19T02:17:15.828ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 zone_address = fd00:1122:3344:101::2
20612024-11-19T02:17:15.828ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
20622024-11-19T02:17:15.829ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee0fffba-d682-49d7-b008-3ab877da86db", "content-length": "26", "date": "Tue, 19 Nov 2024 02:17:15 GMT"} })
20632024-11-19T02:17:15.829ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
20642024-11-19T02:17:15.831ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
20652024-11-19T02:17:15.848ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20662024-11-19T02:17:15.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20672024-11-19T02:17:15.884ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 161.720561ms iteration = 19 status = {"physical_disks_added":0}
20682024-11-19T02:17:15.943ZINFOnexus (BackgroundTasks): VPC route manager sled ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
20692024-11-19T02:17:15.943ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
20702024-11-19T02:17:15.944ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "330288d4-9315-4534-9c32-e484c62060d3", "content-length": "372", "date": "Tue, 19 Nov 2024 02:17:15 GMT"} })
20712024-11-19T02:17:15.944ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20722024-11-19T02:17:15.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20732024-11-19T02:17:15.946ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 224.460399ms iteration = 16 status = {}
20742024-11-19T02:17:15.961ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
20752024-11-19T02:17:15.961ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
20762024-11-19T02:17:15.961ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "14c65e48-585b-4c83-ba8a-3b08c7039d36", "date": "Tue, 19 Nov 2024 02:17:15 GMT"} })
20772024-11-19T02:17:15.961ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20782024-11-19T02:17:15.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20792024-11-19T02:17:15.965ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
20802024-11-19T02:17:15.965ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ecfcec8-0481-4b8f-bb9b-79b973305f41", "content-length": "1", "date": "Tue, 19 Nov 2024 02:17:15 GMT"} })
20812024-11-19T02:17:15.966ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20822024-11-19T02:17:15.966ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20832024-11-19T02:17:15.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20842024-11-19T02:17:15.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20852024-11-19T02:17:15.967ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
20862024-11-19T02:17:15.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
20872024-11-19T02:17:15.968ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20882024-11-19T02:17:15.969ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 247.997888ms iteration = 16 status = null
20892024-11-19T02:17:15.969ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20902024-11-19T02:17:15.969ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20912024-11-19T02:17:15.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20922024-11-19T02:17:15.970ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20932024-11-19T02:17:15.971ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20942024-11-19T02:17:15.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20952024-11-19T02:17:15.973ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20962024-11-19T02:17:15.973ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20972024-11-19T02:17:15.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20982024-11-19T02:17:15.974ZINFOnexus (BackgroundTasks): VPC route manager sled ffe74824-0c08-48e1-a755-fb123e8dc181 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
20992024-11-19T02:17:15.974ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
21002024-11-19T02:17:15.974ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "27abefe5-e091-498e-a8f0-885db6fb244b", "date": "Tue, 19 Nov 2024 02:17:15 GMT"} })
21012024-11-19T02:17:15.976ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 253.925457ms iteration = 17 status = {}
21022024-11-19T02:17:15.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e6020929-5331-49e7-92e0-0ccae068af77 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
21032024-11-19T02:17:15.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e6020929-5331-49e7-92e0-0ccae068af77 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
21042024-11-19T02:17:15.999ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2212 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e6020929-5331-49e7-92e0-0ccae068af77 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
21052024-11-19T02:17:16.068ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21062024-11-19T02:17:16.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21072024-11-19T02:17:16.070ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 20bc3881-e2ee-4d8d-b84b-b0c1e478721f, rack_id: a894e92e-d765-4f15-b6b7-cb9ca46d1860, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8597d802-6d4d-4493-88de-333a1f340c20) } rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0
21082024-11-19T02:17:16.070ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21092024-11-19T02:17:16.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21102024-11-19T02:17:16.080ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
21112024-11-19T02:17:16.081ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "562e1602-e4db-48be-adc0-c946de8d187f", "content-length": "134", "date": "Tue, 19 Nov 2024 02:17:15 GMT"} })
21122024-11-19T02:17:16.081ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
21132024-11-19T02:17:16.081ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8597d802-6d4d-4493-88de-333a1f340c20
21142024-11-19T02:17:16.081ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
21152024-11-19T02:17:16.081ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
21162024-11-19T02:17:16.081ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21172024-11-19T02:17:16.081ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21182024-11-19T02:17:16.081ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21192024-11-19T02:17:16.081ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
21202024-11-19T02:17:16.081ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21212024-11-19T02:17:16.081ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
21222024-11-19T02:17:16.081ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
21232024-11-19T02:17:16.081ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21242024-11-19T02:17:16.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21252024-11-19T02:17:16.084ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
21262024-11-19T02:17:16.084ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "281acf2c-2269-48b2-9978-ecaaf0d7a8af", "content-length": "2", "date": "Tue, 19 Nov 2024 02:17:15 GMT"} })
21272024-11-19T02:17:16.084ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
21282024-11-19T02:17:16.084ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c7ab54e-1fd0-4141-884e-d50d12c3533b", "content-length": "52", "date": "Tue, 19 Nov 2024 02:17:15 GMT"} })
21292024-11-19T02:17:16.084ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0
21302024-11-19T02:17:16.084ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
21312024-11-19T02:17:16.099ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
21322024-11-19T02:17:16.213ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "b9374830-cde4-4540-874b-f66b354d5765", "date": "Tue, 19 Nov 2024 02:17:15 GMT"} })
21332024-11-19T02:17:16.213ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch = Switch0
21342024-11-19T02:17:16.213ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
21352024-11-19T02:17:16.214ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc9a77bb-201e-47c2-9c88-fa63be91344a", "content-length": "682", "date": "Tue, 19 Nov 2024 02:17:15 GMT"} })
21362024-11-19T02:17:16.214ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21372024-11-19T02:17:16.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21382024-11-19T02:17:16.214ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "39bd95b3-d10f-4b72-ab2f-14d250b1fc1b", "content-length": "691", "date": "Tue, 19 Nov 2024 02:17:16 GMT"} })
21392024-11-19T02:17:16.214ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
21402024-11-19T02:17:16.214ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
21412024-11-19T02:17:16.214ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
21422024-11-19T02:17:16.216ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 493.477828ms iteration = 16 status = {}
21432024-11-19T02:17:16.220ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21442024-11-19T02:17:16.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21452024-11-19T02:17:16.225ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21462024-11-19T02:17:16.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21472024-11-19T02:17:16.228ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21482024-11-19T02:17:16.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21492024-11-19T02:17:16.237ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 515.180476ms iteration = 16 status = {}
21502024-11-19T02:17:16.278ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:65321
21512024-11-19T02:17:16.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:65321 req_id = 456627f0-5c6b-4ba5-ba5f-4df010666228 roles = RoleSet { roles: {} } uri = /metrics/producers
21522024-11-19T02:17:16.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:65321 req_id = 456627f0-5c6b-4ba5-ba5f-4df010666228 resource = Database result = Ok(()) uri = /metrics/producers
21532024-11-19T02:17:16.292ZINFOnexus: assigned collector to new producer collector_id = 3980dd20-a3be-40d3-b9e5-094b8ed4b785 file = nexus/src/app/oximeter.rs:76 producer_id = 8e12c1ab-c863-4549-add8-1474df60b506
21542024-11-19T02:17:16.292ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 13468 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:65321 req_id = 456627f0-5c6b-4ba5-ba5f-4df010666228 response_code = 201 uri = /metrics/producers
21552024-11-19T02:17:16.802ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = 77ad4fe5-b593-46c0-9de4-b8649e0be2c1 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
21562024-11-19T02:17:16.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = 77ad4fe5-b593-46c0-9de4-b8649e0be2c1 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
21572024-11-19T02:17:16.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2680 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = 77ad4fe5-b593-46c0-9de4-b8649e0be2c1 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
21582024-11-19T02:17:17.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 7453c6b0-7e9f-4197-a0bc-803d0990b4fe roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
21592024-11-19T02:17:17.022ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 7453c6b0-7e9f-4197-a0bc-803d0990b4fe resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
21602024-11-19T02:17:17.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2321 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 7453c6b0-7e9f-4197-a0bc-803d0990b4fe response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
21612024-11-19T02:17:18.043ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 843250cb-26f9-4152-b9fd-a99c2182db16 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
21622024-11-19T02:17:18.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 843250cb-26f9-4152-b9fd-a99c2182db16 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
21632024-11-19T02:17:18.045ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2261 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 843250cb-26f9-4152-b9fd-a99c2182db16 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
21642024-11-19T02:17:18.659ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:35007
21652024-11-19T02:17:18.659ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:35007 req_id = 90de07ea-8ce3-4329-a042-87cc63abe2b1 roles = RoleSet { roles: {} } uri = /metrics/producers
21662024-11-19T02:17:18.659ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:35007 req_id = 90de07ea-8ce3-4329-a042-87cc63abe2b1 resource = Database result = Ok(()) uri = /metrics/producers
21672024-11-19T02:17:18.680ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:59865
21682024-11-19T02:17:18.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59865 req_id = ef549f0e-3e40-49ea-b334-2c98f6bde1e9 roles = RoleSet { roles: {} } uri = /metrics/producers
21692024-11-19T02:17:18.680ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59865 req_id = ef549f0e-3e40-49ea-b334-2c98f6bde1e9 resource = Database result = Ok(()) uri = /metrics/producers
21702024-11-19T02:17:18.700ZINFOnexus: assigned collector to new producer collector_id = 3980dd20-a3be-40d3-b9e5-094b8ed4b785 file = nexus/src/app/oximeter.rs:76 producer_id = ddf2e18a-a42b-49da-ad7e-ae7886578501
21712024-11-19T02:17:18.700ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40581 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:35007 req_id = 90de07ea-8ce3-4329-a042-87cc63abe2b1 response_code = 201 uri = /metrics/producers
21722024-11-19T02:17:18.700ZINFOnexus: assigned collector to new producer collector_id = 3980dd20-a3be-40d3-b9e5-094b8ed4b785 file = nexus/src/app/oximeter.rs:76 producer_id = 4f0e9442-b890-4bd0-8290-362b3608ea68
21732024-11-19T02:17:18.700ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 19652 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59865 req_id = ef549f0e-3e40-49ea-b334-2c98f6bde1e9 response_code = 201 uri = /metrics/producers
21742024-11-19T02:17:19.067ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 22775310-b5b3-453a-81ee-12b8852fc244 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
21752024-11-19T02:17:19.067ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 22775310-b5b3-453a-81ee-12b8852fc244 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
21762024-11-19T02:17:19.068ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1830 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 22775310-b5b3-453a-81ee-12b8852fc244 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
21772024-11-19T02:17:20.089ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0d9fba45-2076-4ef0-afa5-99d56e4233ce roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
21782024-11-19T02:17:20.090ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0d9fba45-2076-4ef0-afa5-99d56e4233ce resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
21792024-11-19T02:17:20.091ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1940 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0d9fba45-2076-4ef0-afa5-99d56e4233ce response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
21802024-11-19T02:17:21.112ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ea47aade-6e6c-4196-ab1d-a263c04ac3d9 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
21812024-11-19T02:17:21.112ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ea47aade-6e6c-4196-ab1d-a263c04ac3d9 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
21822024-11-19T02:17:21.114ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2581 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ea47aade-6e6c-4196-ab1d-a263c04ac3d9 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
21832024-11-19T02:17:22.136ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = f57eacd6-da5d-4c55-a492-18b92336d142 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
21842024-11-19T02:17:22.137ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = f57eacd6-da5d-4c55-a492-18b92336d142 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
21852024-11-19T02:17:22.138ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2342 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = f57eacd6-da5d-4c55-a492-18b92336d142 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
21862024-11-19T02:17:22.150ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1274 local_addr = [fd00:1122:3344:101::c]:60807 method = GET remote_addr = [fd00:1122:3344:101::d]:57844 req_id = 44cb042e-d7c5-45da-9f8e-60b863143317 response_code = 200 uri = /9f0b435f-0000-451e-9dbc-dcec71543c30
21872024-11-19T02:17:23.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 618b97ee-1595-4028-8557-239f8b6321b3 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
21882024-11-19T02:17:23.160ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 618b97ee-1595-4028-8557-239f8b6321b3 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
21892024-11-19T02:17:23.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1893 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 618b97ee-1595-4028-8557-239f8b6321b3 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
21902024-11-19T02:17:24.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9d53a9f1-0734-40ec-b8dc-08f949f866c7 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
21912024-11-19T02:17:24.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9d53a9f1-0734-40ec-b8dc-08f949f866c7 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
21922024-11-19T02:17:24.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1877 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9d53a9f1-0734-40ec-b8dc-08f949f866c7 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
21932024-11-19T02:17:25.204ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 03e35b0c-1ad7-4499-9ecb-14ab7269f76f roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
21942024-11-19T02:17:25.205ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 03e35b0c-1ad7-4499-9ecb-14ab7269f76f resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
21952024-11-19T02:17:25.207ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2436 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 03e35b0c-1ad7-4499-9ecb-14ab7269f76f response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
21962024-11-19T02:17:25.723ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
21972024-11-19T02:17:25.723ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21982024-11-19T02:17:25.723ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
21992024-11-19T02:17:25.723ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22002024-11-19T02:17:25.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22012024-11-19T02:17:25.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22022024-11-19T02:17:25.725ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22032024-11-19T02:17:25.728ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
22042024-11-19T02:17:25.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22052024-11-19T02:17:25.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22062024-11-19T02:17:25.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22072024-11-19T02:17:25.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22082024-11-19T02:17:25.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22092024-11-19T02:17:25.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
22102024-11-19T02:17:25.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22112024-11-19T02:17:25.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22122024-11-19T02:17:25.747ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
22132024-11-19T02:17:25.747ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.316398ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
22142024-11-19T02:17:25.753ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22152024-11-19T02:17:25.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22162024-11-19T02:17:25.754ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.623322ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
22172024-11-19T02:17:26.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9ce45d29-8bea-465a-8145-b25764acffa2 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
22182024-11-19T02:17:26.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9ce45d29-8bea-465a-8145-b25764acffa2 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
22192024-11-19T02:17:26.229ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2439 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9ce45d29-8bea-465a-8145-b25764acffa2 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
22202024-11-19T02:17:27.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = 86183263-21d0-4e02-b0ed-c4a446589a29 roles = RoleSet { roles: {} } uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?sort_by=id_ascending
22212024-11-19T02:17:27.143ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = 86183263-21d0-4e02-b0ed-c4a446589a29 resource = Database result = Ok(()) uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?sort_by=id_ascending
22222024-11-19T02:17:27.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2765 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = 86183263-21d0-4e02-b0ed-c4a446589a29 response_code = 200 uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?sort_by=id_ascending
22232024-11-19T02:17:27.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = d6206b59-535a-49d9-ab8e-a2b747e2650d roles = RoleSet { roles: {} } uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZmU3NDgyNC0wYzA4LTQ4ZTEtYTc1NS1mYjEyM2U4ZGMxODEifX0%3D
22242024-11-19T02:17:27.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = d6206b59-535a-49d9-ab8e-a2b747e2650d resource = Database result = Ok(()) uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZmU3NDgyNC0wYzA4LTQ4ZTEtYTc1NS1mYjEyM2U4ZGMxODEifX0%3D
22252024-11-19T02:17:27.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2235 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = d6206b59-535a-49d9-ab8e-a2b747e2650d response_code = 200 uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZmU3NDgyNC0wYzA4LTQ4ZTEtYTc1NS1mYjEyM2U4ZGMxODEifX0%3D
22262024-11-19T02:17:27.251ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 435e145a-c9ca-4f33-85d7-e621a791c812 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
22272024-11-19T02:17:27.251ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 435e145a-c9ca-4f33-85d7-e621a791c812 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
22282024-11-19T02:17:27.253ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1959 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 435e145a-c9ca-4f33-85d7-e621a791c812 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
22292024-11-19T02:17:28.275ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b8d89d8d-2261-46e2-93fd-150f7f0fc5d1 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
22302024-11-19T02:17:28.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b8d89d8d-2261-46e2-93fd-150f7f0fc5d1 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
22312024-11-19T02:17:28.278ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2420 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b8d89d8d-2261-46e2-93fd-150f7f0fc5d1 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
22322024-11-19T02:17:29.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e494b6a6-4ada-4d02-a715-90c45a202f20 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
22332024-11-19T02:17:29.298ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e494b6a6-4ada-4d02-a715-90c45a202f20 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
22342024-11-19T02:17:29.300ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2070 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e494b6a6-4ada-4d02-a715-90c45a202f20 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
22352024-11-19T02:17:30.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 19a320a1-16b2-43b5-b7ea-585fd512ef8e roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
22362024-11-19T02:17:30.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 19a320a1-16b2-43b5-b7ea-585fd512ef8e resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
22372024-11-19T02:17:30.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2531 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 19a320a1-16b2-43b5-b7ea-585fd512ef8e response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
22382024-11-19T02:17:31.346ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = df355667-2261-4a2a-90cf-c842660fd7de roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
22392024-11-19T02:17:31.347ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = df355667-2261-4a2a-90cf-c842660fd7de resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
22402024-11-19T02:17:31.348ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2118 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = df355667-2261-4a2a-90cf-c842660fd7de response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
22412024-11-19T02:17:32.370ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 09a0d388-f186-4f82-a055-1bcf943e7440 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
22422024-11-19T02:17:32.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 09a0d388-f186-4f82-a055-1bcf943e7440 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
22432024-11-19T02:17:32.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1855 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 09a0d388-f186-4f82-a055-1bcf943e7440 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
22442024-11-19T02:17:33.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d91c6883-0a97-4c2c-a0ba-fcc1eaba985f roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
22452024-11-19T02:17:33.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d91c6883-0a97-4c2c-a0ba-fcc1eaba985f resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
22462024-11-19T02:17:33.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2486 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d91c6883-0a97-4c2c-a0ba-fcc1eaba985f response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
22472024-11-19T02:17:34.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 1d8bb890-0263-4fa2-8f76-f872e1964c89 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
22482024-11-19T02:17:34.417ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 1d8bb890-0263-4fa2-8f76-f872e1964c89 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
22492024-11-19T02:17:34.419ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2451 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 1d8bb890-0263-4fa2-8f76-f872e1964c89 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
22502024-11-19T02:17:35.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 18d0eb0d-300b-4257-955c-81b7b309e8e7 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
22512024-11-19T02:17:35.441ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 18d0eb0d-300b-4257-955c-81b7b309e8e7 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
22522024-11-19T02:17:35.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1929 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 18d0eb0d-300b-4257-955c-81b7b309e8e7 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
22532024-11-19T02:17:35.722ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
22542024-11-19T02:17:35.723ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22552024-11-19T02:17:35.723ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
22562024-11-19T02:17:35.723ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22572024-11-19T02:17:35.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22582024-11-19T02:17:35.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22592024-11-19T02:17:35.725ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22602024-11-19T02:17:35.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22612024-11-19T02:17:35.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22622024-11-19T02:17:35.727ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.120267ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
22632024-11-19T02:17:35.728ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
22642024-11-19T02:17:35.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22652024-11-19T02:17:35.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22662024-11-19T02:17:35.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22672024-11-19T02:17:35.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22682024-11-19T02:17:35.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22692024-11-19T02:17:35.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
22702024-11-19T02:17:35.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22712024-11-19T02:17:35.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22722024-11-19T02:17:35.746ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
22732024-11-19T02:17:35.746ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.928834ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
22742024-11-19T02:17:36.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 74c09d1b-e892-4b42-bed9-f462e4943413 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
22752024-11-19T02:17:36.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 74c09d1b-e892-4b42-bed9-f462e4943413 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
22762024-11-19T02:17:36.466ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2020 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 74c09d1b-e892-4b42-bed9-f462e4943413 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
22772024-11-19T02:17:37.152ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1785 local_addr = [fd00:1122:3344:101::c]:60807 method = GET remote_addr = [fd00:1122:3344:101::d]:57844 req_id = 1734a950-4525-4e4c-8446-060fb2f58833 response_code = 200 uri = /9f0b435f-0000-451e-9dbc-dcec71543c30
22782024-11-19T02:17:37.487ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4a50ed02-c734-4155-9bfe-5b0a885e8e42 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
22792024-11-19T02:17:37.487ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4a50ed02-c734-4155-9bfe-5b0a885e8e42 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
22802024-11-19T02:17:37.489ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2262 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4a50ed02-c734-4155-9bfe-5b0a885e8e42 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
22812024-11-19T02:17:38.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3dc876bf-5a84-4238-a8aa-274d0bee79f6 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
22822024-11-19T02:17:38.510ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3dc876bf-5a84-4238-a8aa-274d0bee79f6 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
22832024-11-19T02:17:38.512ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2219 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3dc876bf-5a84-4238-a8aa-274d0bee79f6 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
22842024-11-19T02:17:39.533ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 8b26e2dd-9244-4180-9137-f70060879dbc roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
22852024-11-19T02:17:39.533ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 8b26e2dd-9244-4180-9137-f70060879dbc resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
22862024-11-19T02:17:39.534ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1743 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 8b26e2dd-9244-4180-9137-f70060879dbc response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
22872024-11-19T02:17:40.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3ec5d532-9a38-45c9-b48e-0445f2c91654 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
22882024-11-19T02:17:40.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3ec5d532-9a38-45c9-b48e-0445f2c91654 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
22892024-11-19T02:17:40.557ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1822 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3ec5d532-9a38-45c9-b48e-0445f2c91654 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
22902024-11-19T02:17:41.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3ebbf48e-2b02-435a-9355-480dba4ce53f roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
22912024-11-19T02:17:41.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3ebbf48e-2b02-435a-9355-480dba4ce53f resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
22922024-11-19T02:17:41.581ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2498 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3ebbf48e-2b02-435a-9355-480dba4ce53f response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
22932024-11-19T02:17:42.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 646d9afb-8b0d-4d4f-80e3-c8b6acbd5ab9 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
22942024-11-19T02:17:42.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 646d9afb-8b0d-4d4f-80e3-c8b6acbd5ab9 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
22952024-11-19T02:17:42.604ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2159 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 646d9afb-8b0d-4d4f-80e3-c8b6acbd5ab9 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
22962024-11-19T02:17:43.626ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ff8cc738-ed0b-465d-b652-a65c1f604e6b roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
22972024-11-19T02:17:43.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ff8cc738-ed0b-465d-b652-a65c1f604e6b resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
22982024-11-19T02:17:43.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2473 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ff8cc738-ed0b-465d-b652-a65c1f604e6b response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
22992024-11-19T02:17:44.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0fe39606-c4ff-486f-bcc2-2c6669f1727c roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
23002024-11-19T02:17:44.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0fe39606-c4ff-486f-bcc2-2c6669f1727c resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
23012024-11-19T02:17:44.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2348 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0fe39606-c4ff-486f-bcc2-2c6669f1727c response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
23022024-11-19T02:17:45.673ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e898fbe8-e182-4984-9e45-5a4099a40944 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
23032024-11-19T02:17:45.674ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e898fbe8-e182-4984-9e45-5a4099a40944 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
23042024-11-19T02:17:45.675ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1802 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e898fbe8-e182-4984-9e45-5a4099a40944 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
23052024-11-19T02:17:45.722ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
23062024-11-19T02:17:45.722ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
23072024-11-19T02:17:45.722ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-19 02:07:45.722495623 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
23082024-11-19T02:17:45.722ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
23092024-11-19T02:17:45.722ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
23102024-11-19T02:17:45.722ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23112024-11-19T02:17:45.722ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
23122024-11-19T02:17:45.722ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
23132024-11-19T02:17:45.722ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
23142024-11-19T02:17:45.722ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
23152024-11-19T02:17:45.722ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23162024-11-19T02:17:45.722ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
23172024-11-19T02:17:45.722ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
23182024-11-19T02:17:45.722ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
23192024-11-19T02:17:45.722ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
23202024-11-19T02:17:45.722ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
23212024-11-19T02:17:45.722ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23222024-11-19T02:17:45.722ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
23232024-11-19T02:17:45.722ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
23242024-11-19T02:17:45.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
23252024-11-19T02:17:45.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23262024-11-19T02:17:45.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
23272024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
23282024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
23292024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
23302024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
23312024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23322024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
23332024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
23342024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
23352024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
23362024-11-19T02:17:45.723ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
23372024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23382024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
23392024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23402024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23412024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
23422024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
23432024-11-19T02:17:45.723ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
23442024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
23452024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
23462024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
23472024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
23482024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
23492024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
23502024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23512024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
23522024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
23532024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
23542024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23552024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
23562024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23572024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
23582024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
23592024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
23602024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
23612024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
23622024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
23632024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
23642024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
23652024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23662024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
23672024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
23682024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
23692024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23702024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
23712024-11-19T02:17:45.723ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115
23722024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.91\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115"}
23732024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
23742024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23752024-11-19T02:17:45.723ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("27d1a6ca-1b76-4956-aefa-e234c7d60cd0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("91bdcbd0-987b-49c4-8200-fc3e8f332b6b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("91bdcbd0-987b-49c4-8200-fc3e8f332b6b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1363, tv_nsec: 510292582 } })
23762024-11-19T02:17:45.723ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2d59cdb7-e3b1-4e94-afa3-f64f69928234.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a949a8d8-46c7-4423-b760-c03f98ccf638.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b190a9bf-d8b7-43c3-add4-e113c9b89870.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b190a9bf-d8b7-43c3-add4-e113c9b89870.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1363, tv_nsec: 510294822 } })
23772024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
23782024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23792024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
23802024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23812024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
23822024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
23832024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23842024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23852024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
23862024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
23872024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
23882024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23892024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
23902024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
23912024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23922024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
23932024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
23942024-11-19T02:17:45.723ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.406726ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
23952024-11-19T02:17:45.724ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
23962024-11-19T02:17:45.724ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.484117ms iteration = 10 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
23972024-11-19T02:17:45.724ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23982024-11-19T02:17:45.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23992024-11-19T02:17:45.724ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-19 02:07:45.722495623 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
24002024-11-19T02:17:45.724ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 2.416148ms iteration = 9 status = {"expiration":"2024-11-19T02:07:45.722495623Z","pruned":[]}
24012024-11-19T02:17:45.726ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1363, tv_nsec: 513031514 } })
24022024-11-19T02:17:45.726ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
24032024-11-19T02:17:45.726ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24042024-11-19T02:17:45.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24052024-11-19T02:17:45.726ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24062024-11-19T02:17:45.727ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1363, tv_nsec: 514058665 } })
24072024-11-19T02:17:45.727ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
24082024-11-19T02:17:45.728ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
24092024-11-19T02:17:45.728ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24102024-11-19T02:17:45.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24112024-11-19T02:17:45.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24122024-11-19T02:17:45.729ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.16772ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
24132024-11-19T02:17:45.731ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 7.950051ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
24142024-11-19T02:17:45.731ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24152024-11-19T02:17:45.731ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
24162024-11-19T02:17:45.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24172024-11-19T02:17:45.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24182024-11-19T02:17:45.733ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24192024-11-19T02:17:45.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
24202024-11-19T02:17:45.733ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24212024-11-19T02:17:45.733ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 10.51496ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
24222024-11-19T02:17:45.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24232024-11-19T02:17:45.735ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24242024-11-19T02:17:45.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24252024-11-19T02:17:45.736ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24262024-11-19T02:17:45.736ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
24272024-11-19T02:17:45.736ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
24282024-11-19T02:17:45.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
24292024-11-19T02:17:45.737ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24302024-11-19T02:17:45.738ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
24312024-11-19T02:17:45.738ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24322024-11-19T02:17:45.738ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24332024-11-19T02:17:45.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24342024-11-19T02:17:45.738ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24352024-11-19T02:17:45.738ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
24362024-11-19T02:17:45.738ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
24372024-11-19T02:17:45.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24382024-11-19T02:17:45.739ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24392024-11-19T02:17:45.741ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
24402024-11-19T02:17:45.741ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
24412024-11-19T02:17:45.741ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
24422024-11-19T02:17:45.741ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24432024-11-19T02:17:45.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
24442024-11-19T02:17:45.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24452024-11-19T02:17:45.741ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
24462024-11-19T02:17:45.741ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24472024-11-19T02:17:45.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24482024-11-19T02:17:45.743ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24492024-11-19T02:17:45.743ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24502024-11-19T02:17:45.744ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24512024-11-19T02:17:45.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24522024-11-19T02:17:45.746ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
24532024-11-19T02:17:45.747ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
24542024-11-19T02:17:45.748ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24552024-11-19T02:17:45.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24562024-11-19T02:17:45.749ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1363, tv_nsec: 536256269 } })
24572024-11-19T02:17:45.749ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
24582024-11-19T02:17:45.751ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24592024-11-19T02:17:45.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24602024-11-19T02:17:45.752ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24612024-11-19T02:17:45.756ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
24622024-11-19T02:17:45.756ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24632024-11-19T02:17:45.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24642024-11-19T02:17:45.758ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
24652024-11-19T02:17:45.758ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 35.492686ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
24662024-11-19T02:17:45.759ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24672024-11-19T02:17:45.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24682024-11-19T02:17:45.760ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24692024-11-19T02:17:45.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
24702024-11-19T02:17:45.764ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24712024-11-19T02:17:45.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24722024-11-19T02:17:45.768ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
24732024-11-19T02:17:45.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
24742024-11-19T02:17:45.774ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
24752024-11-19T02:17:45.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
24762024-11-19T02:17:45.777ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 54.225291ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
24772024-11-19T02:17:45.779ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 56.341795ms iteration = 17 status = {"errors":[],"records_set_to_done":[]}
24782024-11-19T02:17:45.782ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
24792024-11-19T02:17:45.782ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
24802024-11-19T02:17:45.782ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 58.889564ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
24812024-11-19T02:17:45.785ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
24822024-11-19T02:17:45.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
24832024-11-19T02:17:45.787ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24842024-11-19T02:17:45.787ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
24852024-11-19T02:17:45.787ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
24862024-11-19T02:17:45.787ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
24872024-11-19T02:17:45.787ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24882024-11-19T02:17:45.787ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 64.252685ms iteration = 17 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
24892024-11-19T02:17:45.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24902024-11-19T02:17:45.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24912024-11-19T02:17:45.788ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
24922024-11-19T02:17:45.788ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
24932024-11-19T02:17:45.788ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
24942024-11-19T02:17:45.788ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24952024-11-19T02:17:45.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24962024-11-19T02:17:45.789ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24972024-11-19T02:17:45.789ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
24982024-11-19T02:17:45.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
24992024-11-19T02:17:45.790ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25002024-11-19T02:17:45.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25012024-11-19T02:17:45.790ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25022024-11-19T02:17:45.791ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
25032024-11-19T02:17:45.791ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
25042024-11-19T02:17:45.791ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
25052024-11-19T02:17:45.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
25062024-11-19T02:17:45.792ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 68.99975ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25072024-11-19T02:17:45.792ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
25082024-11-19T02:17:45.792ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25092024-11-19T02:17:45.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25102024-11-19T02:17:45.794ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
25112024-11-19T02:17:45.794ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
25122024-11-19T02:17:45.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
25132024-11-19T02:17:45.795ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25142024-11-19T02:17:45.796ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
25152024-11-19T02:17:45.796ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = af79c7eb-bc4d-42f8-9217-8b35affeeebb dns_zone_name = oxide.test found_so_far = 0 version = 2
25162024-11-19T02:17:45.796ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
25172024-11-19T02:17:45.796ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25182024-11-19T02:17:45.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
25192024-11-19T02:17:45.797ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: ffe74824-0c08-48e1-a755-fb123e8dc181, lookup_type: ById(ffe74824-0c08-48e1-a755-fb123e8dc181) } result = Ok(())
25202024-11-19T02:17:45.797ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25212024-11-19T02:17:45.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25222024-11-19T02:17:45.798ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25232024-11-19T02:17:45.799ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
25242024-11-19T02:17:45.799ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25252024-11-19T02:17:45.799ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 76.153562ms iteration = 17 status = 0
25262024-11-19T02:17:45.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25272024-11-19T02:17:45.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25282024-11-19T02:17:45.801ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
25292024-11-19T02:17:45.801ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
25302024-11-19T02:17:45.801ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 78.126534ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
25312024-11-19T02:17:45.803ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
25322024-11-19T02:17:45.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25332024-11-19T02:17:45.803ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25342024-11-19T02:17:45.803ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
25352024-11-19T02:17:45.803ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
25362024-11-19T02:17:45.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25372024-11-19T02:17:45.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
25382024-11-19T02:17:45.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
25392024-11-19T02:17:45.810ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = af79c7eb-bc4d-42f8-9217-8b35affeeebb dns_zone_name = oxide.test found_so_far = 1 version = 2
25402024-11-19T02:17:45.810ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
25412024-11-19T02:17:45.810ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-19 02:10:28.769117 UTC dns_group = external generation = 2
25422024-11-19T02:17:45.810ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 87.566852ms iteration = 10 status = {"generation":2}
25432024-11-19T02:17:45.822ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
25442024-11-19T02:17:45.822ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 99.180075ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
25452024-11-19T02:17:45.822ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
25462024-11-19T02:17:45.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
25472024-11-19T02:17:45.830ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
25482024-11-19T02:17:45.830ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 8c04fa4d-031f-4603-9b0e-246b45d39276 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
25492024-11-19T02:17:45.830ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25502024-11-19T02:17:45.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25512024-11-19T02:17:45.832ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
25522024-11-19T02:17:45.832ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
25532024-11-19T02:17:45.832ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 108.886586ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
25542024-11-19T02:17:45.832ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25552024-11-19T02:17:45.835ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
25562024-11-19T02:17:45.835ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25572024-11-19T02:17:45.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25582024-11-19T02:17:45.838ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 8c04fa4d-031f-4603-9b0e-246b45d39276 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
25592024-11-19T02:17:45.838ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
25602024-11-19T02:17:45.838ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-19 02:10:27.714570 UTC dns_group = internal generation = 1
25612024-11-19T02:17:45.838ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 115.946627ms iteration = 10 status = {"generation":1}
25622024-11-19T02:17:45.839ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 115.996748ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
25632024-11-19T02:17:45.843ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
25642024-11-19T02:17:45.843ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25652024-11-19T02:17:45.845ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
25662024-11-19T02:17:45.845ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25672024-11-19T02:17:45.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
25682024-11-19T02:17:45.853ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25692024-11-19T02:17:45.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25702024-11-19T02:17:45.855ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
25712024-11-19T02:17:45.888ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 165.044389ms iteration = 20 status = {"physical_disks_added":0}
25722024-11-19T02:17:45.892ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25732024-11-19T02:17:45.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25742024-11-19T02:17:45.894ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25752024-11-19T02:17:45.896ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-19T02:09:41.910054Z, time_modified: 2024-11-19T02:09:41.910054Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 78638afa-e975-44a9-b764-0afec18d156f, db_silo: Silo { identity: SiloIdentity { id: 78638afa-e975-44a9-b764-0afec18d156f, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-19T02:10:28.623188Z, time_modified: 2024-11-19T02:10:28.623188Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "fe94815f3f5502a309deafc95cd58d4fe61e984b7bd8ad11309589068beb64f5" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 78638afa-e975-44a9-b764-0afec18d156f, db_silo: Silo { identity: SiloIdentity { id: 78638afa-e975-44a9-b764-0afec18d156f, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-19T02:10:28.623188Z, time_modified: 2024-11-19T02:10:28.623188Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "fe94815f3f5502a309deafc95cd58d4fe61e984b7bd8ad11309589068beb64f5" }] }) }
25762024-11-19T02:17:45.896ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 173.436956ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"78638afa-e975-44a9-b764-0afec18d156f","tls_certs":["fe94815f3f5502a309deafc95cd58d4fe61e984b7bd8ad11309589068beb64f5"]}},"default_endpoint":{"silo_id":"78638afa-e975-44a9-b764-0afec18d156f","tls_certs":["fe94815f3f5502a309deafc95cd58d4fe61e984b7bd8ad11309589068beb64f5"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
25772024-11-19T02:17:45.896ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
25782024-11-19T02:17:45.896ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25792024-11-19T02:17:45.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25802024-11-19T02:17:45.898ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25812024-11-19T02:17:45.901ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
25822024-11-19T02:17:45.901ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25832024-11-19T02:17:45.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25842024-11-19T02:17:45.902ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
25852024-11-19T02:17:45.902ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25862024-11-19T02:17:45.902ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a62d3c04-b1d1-480a-b29a-fa3952f814f4", "content-length": "26", "date": "Tue, 19 Nov 2024 02:17:45 GMT"} })
25872024-11-19T02:17:45.902ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25882024-11-19T02:17:45.904ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
25892024-11-19T02:17:45.936ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
25902024-11-19T02:17:45.937ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 213.730246ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
25912024-11-19T02:17:45.962ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
25922024-11-19T02:17:45.962ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25932024-11-19T02:17:45.962ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5632bb47-d6ad-4aa4-9a3c-6c9ebacbab81", "content-length": "26", "date": "Tue, 19 Nov 2024 02:17:45 GMT"} })
25942024-11-19T02:17:45.962ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25952024-11-19T02:17:45.965ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
25962024-11-19T02:17:46.033ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
25972024-11-19T02:17:46.046ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 zone_address = fd00:1122:3344:101::2
25982024-11-19T02:17:46.046ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25992024-11-19T02:17:46.047ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "81b98e0b-6d02-449c-8c0d-305227859487", "content-length": "26", "date": "Tue, 19 Nov 2024 02:17:45 GMT"} })
26002024-11-19T02:17:46.047ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26012024-11-19T02:17:46.049ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
26022024-11-19T02:17:46.072ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
26032024-11-19T02:17:46.072ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "4fae7330-2e2d-43c3-a45c-a5a8c5fe1aee", "date": "Tue, 19 Nov 2024 02:17:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
26042024-11-19T02:17:46.072ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
26052024-11-19T02:17:46.073ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
26062024-11-19T02:17:46.073ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a5cec33-bd21-47bc-90c7-e21519e44ab6", "content-length": "691", "date": "Tue, 19 Nov 2024 02:17:46 GMT"} })
26072024-11-19T02:17:46.074ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
26082024-11-19T02:17:46.074ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
26092024-11-19T02:17:46.074ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
26102024-11-19T02:17:46.075ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "aafc2c57-046f-40d8-b161-7cf86b5c8994", "date": "Tue, 19 Nov 2024 02:17:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
26112024-11-19T02:17:46.075ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
26122024-11-19T02:17:46.077ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 354.069873ms iteration = 17 status = {}
26132024-11-19T02:17:46.078ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
26142024-11-19T02:17:46.078ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 356.038086ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
26152024-11-19T02:17:46.096ZINFOnexus (BackgroundTasks): VPC route manager sled ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
26162024-11-19T02:17:46.096ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
26172024-11-19T02:17:46.096ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb089a0e-646a-462d-936c-6af39d6dd745", "content-length": "372", "date": "Tue, 19 Nov 2024 02:17:46 GMT"} })
26182024-11-19T02:17:46.096ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26192024-11-19T02:17:46.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26202024-11-19T02:17:46.107ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 385.109608ms iteration = 17 status = {}
26212024-11-19T02:17:46.117ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
26222024-11-19T02:17:46.117ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
26232024-11-19T02:17:46.117ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f737fc57-8476-40a3-a5ef-1d50969c26df", "date": "Tue, 19 Nov 2024 02:17:46 GMT"} })
26242024-11-19T02:17:46.117ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26252024-11-19T02:17:46.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26262024-11-19T02:17:46.133ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26272024-11-19T02:17:46.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26282024-11-19T02:17:46.135ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
26292024-11-19T02:17:46.136ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "51caffe1-1a3d-48a3-9ce4-4dd8201f7d9a", "content-length": "1", "date": "Tue, 19 Nov 2024 02:17:45 GMT"} })
26302024-11-19T02:17:46.137ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
26312024-11-19T02:17:46.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
26322024-11-19T02:17:46.142ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26332024-11-19T02:17:46.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26342024-11-19T02:17:46.145ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 422.569386ms iteration = 17 status = null
26352024-11-19T02:17:46.147ZINFOnexus (BackgroundTasks): VPC route manager sled ffe74824-0c08-48e1-a755-fb123e8dc181 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
26362024-11-19T02:17:46.147ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
26372024-11-19T02:17:46.147ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ac171dc1-9093-4340-bd31-32254916e8ce", "date": "Tue, 19 Nov 2024 02:17:46 GMT"} })
26382024-11-19T02:17:46.149ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 426.234799ms iteration = 18 status = {}
26392024-11-19T02:17:46.153ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
26402024-11-19T02:17:46.153ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "2b9e81a6-6bbc-4526-b00c-de1d9a160b11", "date": "Tue, 19 Nov 2024 02:17:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
26412024-11-19T02:17:46.153ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
26422024-11-19T02:17:46.155ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "1967f52a-229e-4346-b29f-17f628410eec", "date": "Tue, 19 Nov 2024 02:17:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
26432024-11-19T02:17:46.155ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
26442024-11-19T02:17:46.157ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "861ec987-6285-408c-81ea-e10ddf23eaf2", "date": "Tue, 19 Nov 2024 02:17:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
26452024-11-19T02:17:46.157ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
26462024-11-19T02:17:46.158ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
26472024-11-19T02:17:46.158ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 436.060151ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
26482024-11-19T02:17:46.221ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26492024-11-19T02:17:46.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26502024-11-19T02:17:46.223ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 20bc3881-e2ee-4d8d-b84b-b0c1e478721f, rack_id: a894e92e-d765-4f15-b6b7-cb9ca46d1860, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8597d802-6d4d-4493-88de-333a1f340c20) } rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0
26512024-11-19T02:17:46.223ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26522024-11-19T02:17:46.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26532024-11-19T02:17:46.235ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
26542024-11-19T02:17:46.235ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "fead93fc-d09c-4a9d-be9e-d847b2a40316", "content-length": "134", "date": "Tue, 19 Nov 2024 02:17:45 GMT"} })
26552024-11-19T02:17:46.235ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
26562024-11-19T02:17:46.235ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8597d802-6d4d-4493-88de-333a1f340c20
26572024-11-19T02:17:46.236ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
26582024-11-19T02:17:46.236ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
26592024-11-19T02:17:46.236ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26602024-11-19T02:17:46.236ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26612024-11-19T02:17:46.236ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26622024-11-19T02:17:46.236ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
26632024-11-19T02:17:46.236ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26642024-11-19T02:17:46.236ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
26652024-11-19T02:17:46.236ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
26662024-11-19T02:17:46.236ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26672024-11-19T02:17:46.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26682024-11-19T02:17:46.238ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
26692024-11-19T02:17:46.239ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "42612160-57a3-4f85-aa8d-80bce7746161", "content-length": "2", "date": "Tue, 19 Nov 2024 02:17:45 GMT"} })
26702024-11-19T02:17:46.239ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
26712024-11-19T02:17:46.239ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "d681d11e-688a-44f5-b447-1866dfa572b3", "content-length": "52", "date": "Tue, 19 Nov 2024 02:17:45 GMT"} })
26722024-11-19T02:17:46.239ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0
26732024-11-19T02:17:46.239ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
26742024-11-19T02:17:46.352ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "b6ab1bc8-b759-4688-ab5e-9753cd3f5edc", "date": "Tue, 19 Nov 2024 02:17:46 GMT"} })
26752024-11-19T02:17:46.352ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch = Switch0
26762024-11-19T02:17:46.352ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
26772024-11-19T02:17:46.352ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "debfbd41-49f9-418d-a7b9-313e0a29091f", "content-length": "682", "date": "Tue, 19 Nov 2024 02:17:46 GMT"} })
26782024-11-19T02:17:46.352ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26792024-11-19T02:17:46.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26802024-11-19T02:17:46.356ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26812024-11-19T02:17:46.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26822024-11-19T02:17:46.361ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26832024-11-19T02:17:46.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26842024-11-19T02:17:46.363ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26852024-11-19T02:17:46.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26862024-11-19T02:17:46.371ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 648.153079ms iteration = 17 status = {}
26872024-11-19T02:17:46.743ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 1789da5b-aa24-447a-8a77-b77e531fc55c roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
26882024-11-19T02:17:46.743ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 1789da5b-aa24-447a-8a77-b77e531fc55c resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
26892024-11-19T02:17:46.745ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2456 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 1789da5b-aa24-447a-8a77-b77e531fc55c response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
26902024-11-19T02:17:46.836ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = ee953886-a234-4f81-a554-d287502713cf roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
26912024-11-19T02:17:46.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = ee953886-a234-4f81-a554-d287502713cf resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
26922024-11-19T02:17:46.840ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3659 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = ee953886-a234-4f81-a554-d287502713cf response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
26932024-11-19T02:17:47.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 1b75bc1d-9020-4f7a-808c-2f918f226efc roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
26942024-11-19T02:17:47.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 1b75bc1d-9020-4f7a-808c-2f918f226efc resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
26952024-11-19T02:17:47.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1667 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 1b75bc1d-9020-4f7a-808c-2f918f226efc response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
26962024-11-19T02:17:48.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6b7d4e5e-2aea-4e88-ba5c-8d5258c15047 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
26972024-11-19T02:17:48.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6b7d4e5e-2aea-4e88-ba5c-8d5258c15047 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
26982024-11-19T02:17:48.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1858 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6b7d4e5e-2aea-4e88-ba5c-8d5258c15047 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
26992024-11-19T02:17:49.812ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = bac6ffd8-376c-4386-9ec6-bf65f84384d1 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
27002024-11-19T02:17:49.813ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = bac6ffd8-376c-4386-9ec6-bf65f84384d1 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
27012024-11-19T02:17:49.814ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2165 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = bac6ffd8-376c-4386-9ec6-bf65f84384d1 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
27022024-11-19T02:17:50.836ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 2a93af24-873a-43af-b42b-30a66db5e528 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
27032024-11-19T02:17:50.836ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 2a93af24-873a-43af-b42b-30a66db5e528 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
27042024-11-19T02:17:50.838ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2271 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 2a93af24-873a-43af-b42b-30a66db5e528 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
27052024-11-19T02:17:51.860ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4bc9987c-7e4c-4d49-91bb-56dc2a368bfb roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
27062024-11-19T02:17:51.860ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4bc9987c-7e4c-4d49-91bb-56dc2a368bfb resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
27072024-11-19T02:17:51.862ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2068 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4bc9987c-7e4c-4d49-91bb-56dc2a368bfb response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
27082024-11-19T02:17:52.151ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1274 local_addr = [fd00:1122:3344:101::c]:60807 method = GET remote_addr = [fd00:1122:3344:101::d]:57844 req_id = 5ed4430a-7c83-4245-9854-8e8e291befac response_code = 200 uri = /9f0b435f-0000-451e-9dbc-dcec71543c30
27092024-11-19T02:17:52.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e3c61bb9-4a52-4553-be74-da633d961df8 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
27102024-11-19T02:17:52.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e3c61bb9-4a52-4553-be74-da633d961df8 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
27112024-11-19T02:17:52.886ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1656 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e3c61bb9-4a52-4553-be74-da633d961df8 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
27122024-11-19T02:17:53.908ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b1f86f5d-f788-43c2-bd8e-eabf56941cae roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
27132024-11-19T02:17:53.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b1f86f5d-f788-43c2-bd8e-eabf56941cae resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
27142024-11-19T02:17:53.911ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2350 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b1f86f5d-f788-43c2-bd8e-eabf56941cae response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
27152024-11-19T02:17:54.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a330e1a8-2f8d-4a31-9a1b-6e627598e554 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
27162024-11-19T02:17:54.934ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a330e1a8-2f8d-4a31-9a1b-6e627598e554 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
27172024-11-19T02:17:54.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2294 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a330e1a8-2f8d-4a31-9a1b-6e627598e554 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
27182024-11-19T02:17:55.723ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
27192024-11-19T02:17:55.724ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27202024-11-19T02:17:55.724ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
27212024-11-19T02:17:55.724ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27222024-11-19T02:17:55.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27232024-11-19T02:17:55.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27242024-11-19T02:17:55.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27252024-11-19T02:17:55.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27262024-11-19T02:17:55.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27272024-11-19T02:17:55.728ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.536752ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27282024-11-19T02:17:55.729ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27292024-11-19T02:17:55.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27302024-11-19T02:17:55.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27312024-11-19T02:17:55.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27322024-11-19T02:17:55.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27332024-11-19T02:17:55.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27342024-11-19T02:17:55.736ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
27352024-11-19T02:17:55.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27362024-11-19T02:17:55.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27372024-11-19T02:17:55.748ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
27382024-11-19T02:17:55.748ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.980686ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
27392024-11-19T02:17:55.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = f457af89-5cd0-492e-bbae-9e85ec31b0ea roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
27402024-11-19T02:17:55.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = f457af89-5cd0-492e-bbae-9e85ec31b0ea resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
27412024-11-19T02:17:55.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2196 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = f457af89-5cd0-492e-bbae-9e85ec31b0ea response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
27422024-11-19T02:17:56.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = f41ad49b-ca35-4ecc-9fc3-12666f291b8d roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
27432024-11-19T02:17:56.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = f41ad49b-ca35-4ecc-9fc3-12666f291b8d resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
27442024-11-19T02:17:56.981ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1840 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = f41ad49b-ca35-4ecc-9fc3-12666f291b8d response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
27452024-11-19T02:17:58.001ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c3367748-f2f8-491f-af0d-bbad8eb13531 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
27462024-11-19T02:17:58.001ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c3367748-f2f8-491f-af0d-bbad8eb13531 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
27472024-11-19T02:17:58.003ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2241 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c3367748-f2f8-491f-af0d-bbad8eb13531 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
27482024-11-19T02:17:59.027ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4dc31547-dd19-4f19-ad00-fa53fde1f925 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
27492024-11-19T02:17:59.027ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4dc31547-dd19-4f19-ad00-fa53fde1f925 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
27502024-11-19T02:17:59.029ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2132 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4dc31547-dd19-4f19-ad00-fa53fde1f925 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
27512024-11-19T02:18:00.051ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9afc4890-e72e-4ffb-b9e6-a538956d62f5 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
27522024-11-19T02:18:00.051ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9afc4890-e72e-4ffb-b9e6-a538956d62f5 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
27532024-11-19T02:18:00.053ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2001 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9afc4890-e72e-4ffb-b9e6-a538956d62f5 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
27542024-11-19T02:18:00.309ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
27552024-11-19T02:18:00.309ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
27562024-11-19T02:18:00.340ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
27572024-11-19T02:18:00.340ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:65242
27582024-11-19T02:18:00.340ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:65242 req_id = 3bc09086-808f-4487-85aa-90f6ba4380b8 roles = RoleSet { roles: {} } uri = /metrics/producers
27592024-11-19T02:18:00.340ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:65242 req_id = 3bc09086-808f-4487-85aa-90f6ba4380b8 resource = Database result = Ok(()) uri = /metrics/producers
27602024-11-19T02:18:00.349ZINFOnexus: assigned collector to new producer collector_id = 3980dd20-a3be-40d3-b9e5-094b8ed4b785 file = nexus/src/app/oximeter.rs:76 producer_id = 9f0b435f-0000-451e-9dbc-dcec71543c30
27612024-11-19T02:18:00.349ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9180 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:65242 req_id = 3bc09086-808f-4487-85aa-90f6ba4380b8 response_code = 201 uri = /metrics/producers
27622024-11-19T02:18:00.349ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "3bc09086-808f-4487-85aa-90f6ba4380b8", "content-length": "41", "date": "Tue, 19 Nov 2024 02:18:00 GMT"} })
27632024-11-19T02:18:00.351ZDEBGnexus (producer-registration-task): registered with nexus successfully
27642024-11-19T02:18:00.351ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
27652024-11-19T02:18:01.076ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = dba9a947-5288-4396-963a-d31077ed0f29 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
27662024-11-19T02:18:01.076ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = dba9a947-5288-4396-963a-d31077ed0f29 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
27672024-11-19T02:18:01.078ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2386 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = dba9a947-5288-4396-963a-d31077ed0f29 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
27682024-11-19T02:18:02.101ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = eec0d3c5-c052-48c3-925e-e759155772ac roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
27692024-11-19T02:18:02.101ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = eec0d3c5-c052-48c3-925e-e759155772ac resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
27702024-11-19T02:18:02.103ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2244 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = eec0d3c5-c052-48c3-925e-e759155772ac response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
27712024-11-19T02:18:03.124ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9f508543-7acc-490d-84c6-6f310810572b roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
27722024-11-19T02:18:03.125ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9f508543-7acc-490d-84c6-6f310810572b resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
27732024-11-19T02:18:03.127ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2250 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9f508543-7acc-490d-84c6-6f310810572b response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
27742024-11-19T02:18:04.149ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d720c2ca-887d-4fd7-a63a-85629d997526 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
27752024-11-19T02:18:04.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d720c2ca-887d-4fd7-a63a-85629d997526 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
27762024-11-19T02:18:04.151ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2025 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d720c2ca-887d-4fd7-a63a-85629d997526 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
27772024-11-19T02:18:05.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 61cb229e-d102-47e0-88df-89f53cdd4697 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
27782024-11-19T02:18:05.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 61cb229e-d102-47e0-88df-89f53cdd4697 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
27792024-11-19T02:18:05.175ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2482 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 61cb229e-d102-47e0-88df-89f53cdd4697 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
27802024-11-19T02:18:05.723ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
27812024-11-19T02:18:05.723ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
27822024-11-19T02:18:05.723ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27832024-11-19T02:18:05.723ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27842024-11-19T02:18:05.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27852024-11-19T02:18:05.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27862024-11-19T02:18:05.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27872024-11-19T02:18:05.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27882024-11-19T02:18:05.725ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27892024-11-19T02:18:05.726ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.946404ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27902024-11-19T02:18:05.728ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27912024-11-19T02:18:05.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27922024-11-19T02:18:05.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27932024-11-19T02:18:05.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27942024-11-19T02:18:05.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27952024-11-19T02:18:05.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27962024-11-19T02:18:05.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
27972024-11-19T02:18:05.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27982024-11-19T02:18:05.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27992024-11-19T02:18:05.743ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
28002024-11-19T02:18:05.744ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.545385ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
28012024-11-19T02:18:06.196ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 423a8c19-2816-4853-b1b9-4f375f0eb660 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
28022024-11-19T02:18:06.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 423a8c19-2816-4853-b1b9-4f375f0eb660 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
28032024-11-19T02:18:06.198ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1995 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 423a8c19-2816-4853-b1b9-4f375f0eb660 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
28042024-11-19T02:18:07.152ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1254 local_addr = [fd00:1122:3344:101::c]:60807 method = GET remote_addr = [fd00:1122:3344:101::d]:57844 req_id = ca7c26ed-7f62-4726-81a8-de0eaa5b68dd response_code = 200 uri = /9f0b435f-0000-451e-9dbc-dcec71543c30
28052024-11-19T02:18:07.219ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 12e25177-06f5-4ef8-8c84-4a1f345841a1 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
28062024-11-19T02:18:07.219ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 12e25177-06f5-4ef8-8c84-4a1f345841a1 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
28072024-11-19T02:18:07.221ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2424 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 12e25177-06f5-4ef8-8c84-4a1f345841a1 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
28082024-11-19T02:18:08.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 525f2d5e-9b1a-4503-badd-d8805dc0d3db roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
28092024-11-19T02:18:08.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 525f2d5e-9b1a-4503-badd-d8805dc0d3db resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
28102024-11-19T02:18:08.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2012 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 525f2d5e-9b1a-4503-badd-d8805dc0d3db response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
28112024-11-19T02:18:09.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ad132143-98f9-4f91-9e17-7c1a302f3959 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
28122024-11-19T02:18:09.268ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ad132143-98f9-4f91-9e17-7c1a302f3959 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
28132024-11-19T02:18:09.270ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2287 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ad132143-98f9-4f91-9e17-7c1a302f3959 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
28142024-11-19T02:18:10.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e9200a0b-fafa-48e5-a6a9-572aee7b9701 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
28152024-11-19T02:18:10.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e9200a0b-fafa-48e5-a6a9-572aee7b9701 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
28162024-11-19T02:18:10.293ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1570 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e9200a0b-fafa-48e5-a6a9-572aee7b9701 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
28172024-11-19T02:18:11.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4be48cac-3587-4292-a46d-9247722be986 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
28182024-11-19T02:18:11.316ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4be48cac-3587-4292-a46d-9247722be986 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
28192024-11-19T02:18:11.318ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2204 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4be48cac-3587-4292-a46d-9247722be986 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
28202024-11-19T02:18:12.338ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3d7f9050-645e-409e-bc25-5676148ab6f4 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
28212024-11-19T02:18:12.339ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3d7f9050-645e-409e-bc25-5676148ab6f4 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
28222024-11-19T02:18:12.341ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2576 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3d7f9050-645e-409e-bc25-5676148ab6f4 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
28232024-11-19T02:18:13.362ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 8d7dcc00-f873-44d9-8c82-3e252fc12a5c roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
28242024-11-19T02:18:13.363ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 8d7dcc00-f873-44d9-8c82-3e252fc12a5c resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
28252024-11-19T02:18:13.365ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2520 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 8d7dcc00-f873-44d9-8c82-3e252fc12a5c response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
28262024-11-19T02:18:14.385ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4e1a31d5-6ec9-47b3-980e-677b54bb55b8 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
28272024-11-19T02:18:14.385ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4e1a31d5-6ec9-47b3-980e-677b54bb55b8 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
28282024-11-19T02:18:14.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2261 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4e1a31d5-6ec9-47b3-980e-677b54bb55b8 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
28292024-11-19T02:18:15.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9fcaae9c-9fab-4271-949e-098c9d23b19b roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
28302024-11-19T02:18:15.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9fcaae9c-9fab-4271-949e-098c9d23b19b resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
28312024-11-19T02:18:15.409ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1950 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9fcaae9c-9fab-4271-949e-098c9d23b19b response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
28322024-11-19T02:18:15.722ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
28332024-11-19T02:18:15.722ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
28342024-11-19T02:18:15.722ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
28352024-11-19T02:18:15.722ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
28362024-11-19T02:18:15.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
28372024-11-19T02:18:15.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
28382024-11-19T02:18:15.723ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
28392024-11-19T02:18:15.723ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
28402024-11-19T02:18:15.723ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
28412024-11-19T02:18:15.723ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
28422024-11-19T02:18:15.723ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
28432024-11-19T02:18:15.723ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28442024-11-19T02:18:15.723ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28452024-11-19T02:18:15.723ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
28462024-11-19T02:18:15.723ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
28472024-11-19T02:18:15.723ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
28482024-11-19T02:18:15.723ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
28492024-11-19T02:18:15.723ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
28502024-11-19T02:18:15.723ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
28512024-11-19T02:18:15.723ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
28522024-11-19T02:18:15.723ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
28532024-11-19T02:18:15.723ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
28542024-11-19T02:18:15.723ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28552024-11-19T02:18:15.723ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
28562024-11-19T02:18:15.723ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
28572024-11-19T02:18:15.723ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
28582024-11-19T02:18:15.723ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28592024-11-19T02:18:15.723ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
28602024-11-19T02:18:15.723ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28612024-11-19T02:18:15.723ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
28622024-11-19T02:18:15.723ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28632024-11-19T02:18:15.723ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
28642024-11-19T02:18:15.723ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
28652024-11-19T02:18:15.723ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28662024-11-19T02:18:15.723ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
28672024-11-19T02:18:15.723ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
28682024-11-19T02:18:15.723ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
28692024-11-19T02:18:15.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
28702024-11-19T02:18:15.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28712024-11-19T02:18:15.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28722024-11-19T02:18:15.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
28732024-11-19T02:18:15.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
28742024-11-19T02:18:15.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28752024-11-19T02:18:15.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
28762024-11-19T02:18:15.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
28772024-11-19T02:18:15.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28782024-11-19T02:18:15.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
28792024-11-19T02:18:15.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28802024-11-19T02:18:15.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
28812024-11-19T02:18:15.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28822024-11-19T02:18:15.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28832024-11-19T02:18:15.725ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1393, tv_nsec: 511888830 } })
28842024-11-19T02:18:15.725ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1393, tv_nsec: 511899001 } })
28852024-11-19T02:18:15.725ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
28862024-11-19T02:18:15.725ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
28872024-11-19T02:18:15.726ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
28882024-11-19T02:18:15.726ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
28892024-11-19T02:18:15.726ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
28902024-11-19T02:18:15.726ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28912024-11-19T02:18:15.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
28922024-11-19T02:18:15.727ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28932024-11-19T02:18:15.727ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.265619ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
28942024-11-19T02:18:15.728ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28952024-11-19T02:18:15.729ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
28962024-11-19T02:18:15.729ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28972024-11-19T02:18:15.729ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
28982024-11-19T02:18:15.729ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28992024-11-19T02:18:15.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29002024-11-19T02:18:15.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29012024-11-19T02:18:15.730ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
29022024-11-19T02:18:15.730ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29032024-11-19T02:18:15.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29042024-11-19T02:18:15.732ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29052024-11-19T02:18:15.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29062024-11-19T02:18:15.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
29072024-11-19T02:18:15.734ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
29082024-11-19T02:18:15.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
29092024-11-19T02:18:15.736ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29102024-11-19T02:18:15.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29112024-11-19T02:18:15.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29122024-11-19T02:18:15.737ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29132024-11-19T02:18:15.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29142024-11-19T02:18:15.740ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
29152024-11-19T02:18:15.740ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
29162024-11-19T02:18:15.740ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29172024-11-19T02:18:15.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29182024-11-19T02:18:15.743ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29192024-11-19T02:18:15.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29202024-11-19T02:18:15.744ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29212024-11-19T02:18:15.745ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1393, tv_nsec: 531797278 } })
29222024-11-19T02:18:15.745ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
29232024-11-19T02:18:15.747ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29242024-11-19T02:18:15.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29252024-11-19T02:18:15.747ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
29262024-11-19T02:18:15.747ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29272024-11-19T02:18:15.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29282024-11-19T02:18:15.761ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29292024-11-19T02:18:15.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29302024-11-19T02:18:15.763ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29312024-11-19T02:18:15.765ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
29322024-11-19T02:18:15.765ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29332024-11-19T02:18:15.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29342024-11-19T02:18:15.766ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
29352024-11-19T02:18:15.766ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 42.849561ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
29362024-11-19T02:18:15.769ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29372024-11-19T02:18:15.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29382024-11-19T02:18:15.771ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29392024-11-19T02:18:15.771ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29402024-11-19T02:18:15.771ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
29412024-11-19T02:18:15.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29422024-11-19T02:18:15.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
29432024-11-19T02:18:15.772ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 48.90631ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
29442024-11-19T02:18:15.772ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 49.321564ms iteration = 18 status = {"errors":[],"records_set_to_done":[]}
29452024-11-19T02:18:15.773ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29462024-11-19T02:18:15.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
29472024-11-19T02:18:15.774ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29482024-11-19T02:18:15.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29492024-11-19T02:18:15.775ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29502024-11-19T02:18:15.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29512024-11-19T02:18:15.776ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: ffe74824-0c08-48e1-a755-fb123e8dc181, lookup_type: ById(ffe74824-0c08-48e1-a755-fb123e8dc181) } result = Ok(())
29522024-11-19T02:18:15.776ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29532024-11-19T02:18:15.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29542024-11-19T02:18:15.776ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 52.763983ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29552024-11-19T02:18:15.776ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29562024-11-19T02:18:15.776ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29572024-11-19T02:18:15.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29582024-11-19T02:18:15.777ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
29592024-11-19T02:18:15.777ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
29602024-11-19T02:18:15.777ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
29612024-11-19T02:18:15.777ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 54.448773ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
29622024-11-19T02:18:15.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
29632024-11-19T02:18:15.778ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29642024-11-19T02:18:15.778ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 54.579045ms iteration = 18 status = 0
29652024-11-19T02:18:15.778ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
29662024-11-19T02:18:15.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29672024-11-19T02:18:15.779ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
29682024-11-19T02:18:15.779ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29692024-11-19T02:18:15.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29702024-11-19T02:18:15.779ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 55.9671ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
29712024-11-19T02:18:15.780ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
29722024-11-19T02:18:15.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29732024-11-19T02:18:15.780ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
29742024-11-19T02:18:15.780ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29752024-11-19T02:18:15.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29762024-11-19T02:18:15.787ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
29772024-11-19T02:18:15.787ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 63.847901ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
29782024-11-19T02:18:15.789ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 66.115627ms iteration = 21 status = {"physical_disks_added":0}
29792024-11-19T02:18:15.798ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29802024-11-19T02:18:15.799ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
29812024-11-19T02:18:15.800ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29822024-11-19T02:18:15.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29832024-11-19T02:18:15.809ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 86.414719ms iteration = 18 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
29842024-11-19T02:18:15.812ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 88.955018ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
29852024-11-19T02:18:15.817ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
29862024-11-19T02:18:15.817ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
29872024-11-19T02:18:15.817ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "766ffee4-2200-4d7f-9b41-da938606896b", "content-length": "26", "date": "Tue, 19 Nov 2024 02:18:15 GMT"} })
29882024-11-19T02:18:15.817ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
29892024-11-19T02:18:15.819ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
29902024-11-19T02:18:15.847ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 zone_address = fd00:1122:3344:101::2
29912024-11-19T02:18:15.847ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
29922024-11-19T02:18:15.847ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e1fa4fb-5e30-4239-b152-3f3d94f7616e", "content-length": "26", "date": "Tue, 19 Nov 2024 02:18:15 GMT"} })
29932024-11-19T02:18:15.847ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
29942024-11-19T02:18:15.849ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
29952024-11-19T02:18:15.852ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
29962024-11-19T02:18:15.852ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
29972024-11-19T02:18:15.853ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3555026-a576-4662-8089-39752e310db1", "content-length": "26", "date": "Tue, 19 Nov 2024 02:18:15 GMT"} })
29982024-11-19T02:18:15.853ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
29992024-11-19T02:18:15.854ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
30002024-11-19T02:18:15.979ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
30012024-11-19T02:18:15.979ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "6115db9c-d4ad-401f-8670-922fe1bbe896", "content-length": "691", "date": "Tue, 19 Nov 2024 02:18:15 GMT"} })
30022024-11-19T02:18:15.979ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
30032024-11-19T02:18:15.979ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
30042024-11-19T02:18:15.979ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
30052024-11-19T02:18:15.981ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 257.639609ms iteration = 18 status = {}
30062024-11-19T02:18:16.007ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
30072024-11-19T02:18:16.007ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "ed0b5b9a-ce6a-4336-a412-dbab729c9651", "content-length": "1", "date": "Tue, 19 Nov 2024 02:18:15 GMT"} })
30082024-11-19T02:18:16.009ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
30092024-11-19T02:18:16.009ZINFOnexus (BackgroundTasks): VPC route manager sled ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
30102024-11-19T02:18:16.009ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
30112024-11-19T02:18:16.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
30122024-11-19T02:18:16.009ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9618c967-85b2-4529-ab39-75387e3f97af", "content-length": "372", "date": "Tue, 19 Nov 2024 02:18:15 GMT"} })
30132024-11-19T02:18:16.009ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30142024-11-19T02:18:16.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30152024-11-19T02:18:16.011ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 289.208921ms iteration = 18 status = null
30162024-11-19T02:18:16.025ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
30172024-11-19T02:18:16.025ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
30182024-11-19T02:18:16.025ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ff1c702e-33cb-4eab-bcfc-2ff15aa7b3ca", "date": "Tue, 19 Nov 2024 02:18:15 GMT"} })
30192024-11-19T02:18:16.025ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30202024-11-19T02:18:16.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30212024-11-19T02:18:16.027ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30222024-11-19T02:18:16.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30232024-11-19T02:18:16.030ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30242024-11-19T02:18:16.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30252024-11-19T02:18:16.031ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 308.854805ms iteration = 18 status = {}
30262024-11-19T02:18:16.034ZINFOnexus (BackgroundTasks): VPC route manager sled ffe74824-0c08-48e1-a755-fb123e8dc181 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
30272024-11-19T02:18:16.034ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
30282024-11-19T02:18:16.034ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "761dd9b3-ea7f-4cf8-ae14-1ab1a32129d6", "date": "Tue, 19 Nov 2024 02:18:15 GMT"} })
30292024-11-19T02:18:16.036ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 312.837141ms iteration = 19 status = {}
30302024-11-19T02:18:16.085ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30312024-11-19T02:18:16.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30322024-11-19T02:18:16.091ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 20bc3881-e2ee-4d8d-b84b-b0c1e478721f, rack_id: a894e92e-d765-4f15-b6b7-cb9ca46d1860, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8597d802-6d4d-4493-88de-333a1f340c20) } rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0
30332024-11-19T02:18:16.091ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30342024-11-19T02:18:16.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30352024-11-19T02:18:16.102ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
30362024-11-19T02:18:16.102ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "076209a8-750f-4cc0-88fa-33afc3dd0526", "content-length": "134", "date": "Tue, 19 Nov 2024 02:18:15 GMT"} })
30372024-11-19T02:18:16.103ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
30382024-11-19T02:18:16.103ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8597d802-6d4d-4493-88de-333a1f340c20
30392024-11-19T02:18:16.103ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
30402024-11-19T02:18:16.103ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
30412024-11-19T02:18:16.103ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30422024-11-19T02:18:16.103ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30432024-11-19T02:18:16.103ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30442024-11-19T02:18:16.103ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
30452024-11-19T02:18:16.103ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30462024-11-19T02:18:16.103ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
30472024-11-19T02:18:16.103ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
30482024-11-19T02:18:16.103ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30492024-11-19T02:18:16.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30502024-11-19T02:18:16.107ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
30512024-11-19T02:18:16.109ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d817a7d-3fe2-4960-85c0-1ae135bd0f1b", "content-length": "2", "date": "Tue, 19 Nov 2024 02:18:15 GMT"} })
30522024-11-19T02:18:16.109ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
30532024-11-19T02:18:16.109ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "fd9c1de4-03d1-4187-9fa5-4eb7c99e4640", "content-length": "52", "date": "Tue, 19 Nov 2024 02:18:15 GMT"} })
30542024-11-19T02:18:16.109ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0
30552024-11-19T02:18:16.109ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
30562024-11-19T02:18:16.230ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "d0b24a45-09f1-4d8a-a81c-4e11ec5b1da7", "date": "Tue, 19 Nov 2024 02:18:15 GMT"} })
30572024-11-19T02:18:16.230ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch = Switch0
30582024-11-19T02:18:16.230ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
30592024-11-19T02:18:16.231ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "59547fa6-cee0-451d-b266-0ac04a16a43b", "content-length": "682", "date": "Tue, 19 Nov 2024 02:18:16 GMT"} })
30602024-11-19T02:18:16.231ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30612024-11-19T02:18:16.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30622024-11-19T02:18:16.235ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30632024-11-19T02:18:16.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30642024-11-19T02:18:16.237ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30652024-11-19T02:18:16.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30662024-11-19T02:18:16.240ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30672024-11-19T02:18:16.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30682024-11-19T02:18:16.248ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 524.790877ms iteration = 18 status = {}
30692024-11-19T02:18:16.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 17e09c70-8b3a-4a05-a3bf-7b95f200ceac roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
30702024-11-19T02:18:16.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 17e09c70-8b3a-4a05-a3bf-7b95f200ceac resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
30712024-11-19T02:18:16.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2934 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 17e09c70-8b3a-4a05-a3bf-7b95f200ceac response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
30722024-11-19T02:18:16.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = 0da720f5-8e6b-461a-b29b-8cf7921efc6c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
30732024-11-19T02:18:16.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = 0da720f5-8e6b-461a-b29b-8cf7921efc6c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
30742024-11-19T02:18:16.875ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3087 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = 0da720f5-8e6b-461a-b29b-8cf7921efc6c response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
30752024-11-19T02:18:17.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 53d1b60a-7202-44fc-a8e5-5ae0e442c7bb roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
30762024-11-19T02:18:17.458ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 53d1b60a-7202-44fc-a8e5-5ae0e442c7bb resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
30772024-11-19T02:18:17.460ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2160 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 53d1b60a-7202-44fc-a8e5-5ae0e442c7bb response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
30782024-11-19T02:18:18.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = cfd09a03-d8d3-468d-8500-6653a63f1232 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
30792024-11-19T02:18:18.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = cfd09a03-d8d3-468d-8500-6653a63f1232 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
30802024-11-19T02:18:18.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2165 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = cfd09a03-d8d3-468d-8500-6653a63f1232 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
30812024-11-19T02:18:19.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = abd446e7-a9dd-4b21-99a9-ef0d441669ef roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
30822024-11-19T02:18:19.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = abd446e7-a9dd-4b21-99a9-ef0d441669ef resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
30832024-11-19T02:18:19.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2255 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = abd446e7-a9dd-4b21-99a9-ef0d441669ef response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
30842024-11-19T02:18:20.531ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 581edb6b-70c2-468e-87f9-e1916c67580a roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
30852024-11-19T02:18:20.531ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 581edb6b-70c2-468e-87f9-e1916c67580a resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
30862024-11-19T02:18:20.533ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2068 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 581edb6b-70c2-468e-87f9-e1916c67580a response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
30872024-11-19T02:18:21.554ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = db172d19-7a23-42dc-b9a7-d84a38abd97a roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
30882024-11-19T02:18:21.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = db172d19-7a23-42dc-b9a7-d84a38abd97a resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
30892024-11-19T02:18:21.557ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3074 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = db172d19-7a23-42dc-b9a7-d84a38abd97a response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
30902024-11-19T02:18:22.150ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1309 local_addr = [fd00:1122:3344:101::c]:60807 method = GET remote_addr = [fd00:1122:3344:101::d]:57844 req_id = 68673a47-3908-4bca-8507-dfd241decff8 response_code = 200 uri = /9f0b435f-0000-451e-9dbc-dcec71543c30
30912024-11-19T02:18:22.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = cd3684a2-4f80-4117-9692-e6f75443d255 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
30922024-11-19T02:18:22.580ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = cd3684a2-4f80-4117-9692-e6f75443d255 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
30932024-11-19T02:18:22.581ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2266 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = cd3684a2-4f80-4117-9692-e6f75443d255 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
30942024-11-19T02:18:23.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 5e7a786d-ec89-40c1-8e2a-89b00df45638 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
30952024-11-19T02:18:23.603ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 5e7a786d-ec89-40c1-8e2a-89b00df45638 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
30962024-11-19T02:18:23.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1879 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 5e7a786d-ec89-40c1-8e2a-89b00df45638 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
30972024-11-19T02:18:24.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 2b7583de-ffdd-4b3a-8335-3031a2de5552 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
30982024-11-19T02:18:24.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 2b7583de-ffdd-4b3a-8335-3031a2de5552 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
30992024-11-19T02:18:24.628ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2496 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 2b7583de-ffdd-4b3a-8335-3031a2de5552 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
31002024-11-19T02:18:25.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b2ee18ed-ded7-4ece-8de3-4e5891682152 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
31012024-11-19T02:18:25.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b2ee18ed-ded7-4ece-8de3-4e5891682152 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
31022024-11-19T02:18:25.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2489 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b2ee18ed-ded7-4ece-8de3-4e5891682152 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
31032024-11-19T02:18:25.724ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
31042024-11-19T02:18:25.724ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
31052024-11-19T02:18:25.724ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31062024-11-19T02:18:25.724ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31072024-11-19T02:18:25.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31082024-11-19T02:18:25.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31092024-11-19T02:18:25.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31102024-11-19T02:18:25.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31112024-11-19T02:18:25.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31122024-11-19T02:18:25.728ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
31132024-11-19T02:18:25.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31142024-11-19T02:18:25.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31152024-11-19T02:18:25.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31162024-11-19T02:18:25.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31172024-11-19T02:18:25.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31182024-11-19T02:18:25.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
31192024-11-19T02:18:25.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31202024-11-19T02:18:25.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31212024-11-19T02:18:25.747ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
31222024-11-19T02:18:25.747ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.806431ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
31232024-11-19T02:18:25.756ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.100977ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
31242024-11-19T02:18:26.672ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 04266731-5bf7-47ac-8618-cdce6beaa2e3 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
31252024-11-19T02:18:26.672ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 04266731-5bf7-47ac-8618-cdce6beaa2e3 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
31262024-11-19T02:18:26.674ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2064 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 04266731-5bf7-47ac-8618-cdce6beaa2e3 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
31272024-11-19T02:18:27.694ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 445e94e7-a69b-44e4-abfb-65eda76fa236 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
31282024-11-19T02:18:27.694ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 445e94e7-a69b-44e4-abfb-65eda76fa236 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
31292024-11-19T02:18:27.696ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1784 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 445e94e7-a69b-44e4-abfb-65eda76fa236 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
31302024-11-19T02:18:28.717ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 5608e11b-1cc8-4ee5-8511-9352b4486c8c roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
31312024-11-19T02:18:28.717ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 5608e11b-1cc8-4ee5-8511-9352b4486c8c resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
31322024-11-19T02:18:28.719ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1945 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 5608e11b-1cc8-4ee5-8511-9352b4486c8c response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
31332024-11-19T02:18:29.741ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 682fcd5b-03f8-47f9-8358-bcc6d7e2e726 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
31342024-11-19T02:18:29.741ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 682fcd5b-03f8-47f9-8358-bcc6d7e2e726 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
31352024-11-19T02:18:29.743ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2262 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 682fcd5b-03f8-47f9-8358-bcc6d7e2e726 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
31362024-11-19T02:18:30.764ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 43e47493-e0f4-478e-8584-41ca78a7e431 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
31372024-11-19T02:18:30.765ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 43e47493-e0f4-478e-8584-41ca78a7e431 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
31382024-11-19T02:18:30.766ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2085 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 43e47493-e0f4-478e-8584-41ca78a7e431 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
31392024-11-19T02:18:31.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a18394e6-dd1e-433b-86e8-7862636794f7 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
31402024-11-19T02:18:31.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a18394e6-dd1e-433b-86e8-7862636794f7 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
31412024-11-19T02:18:31.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1789 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a18394e6-dd1e-433b-86e8-7862636794f7 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
31422024-11-19T02:18:32.814ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = cb011cb7-a45f-48b1-a103-d2a8b61a7304 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
31432024-11-19T02:18:32.814ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = cb011cb7-a45f-48b1-a103-d2a8b61a7304 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
31442024-11-19T02:18:32.816ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1830 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = cb011cb7-a45f-48b1-a103-d2a8b61a7304 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
31452024-11-19T02:18:33.837ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 43a4fead-b502-4097-b183-7f17f5fa70fc roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
31462024-11-19T02:18:33.838ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 43a4fead-b502-4097-b183-7f17f5fa70fc resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
31472024-11-19T02:18:33.840ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3197 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 43a4fead-b502-4097-b183-7f17f5fa70fc response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
31482024-11-19T02:18:34.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 467920fd-1591-4b77-8b08-8809d8ac4f1b roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
31492024-11-19T02:18:34.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 467920fd-1591-4b77-8b08-8809d8ac4f1b resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
31502024-11-19T02:18:34.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2470 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 467920fd-1591-4b77-8b08-8809d8ac4f1b response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
31512024-11-19T02:18:35.724ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
31522024-11-19T02:18:35.724ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31532024-11-19T02:18:35.724ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
31542024-11-19T02:18:35.724ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31552024-11-19T02:18:35.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31562024-11-19T02:18:35.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31572024-11-19T02:18:35.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31582024-11-19T02:18:35.729ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
31592024-11-19T02:18:35.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31602024-11-19T02:18:35.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31612024-11-19T02:18:35.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31622024-11-19T02:18:35.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31632024-11-19T02:18:35.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31642024-11-19T02:18:35.738ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
31652024-11-19T02:18:35.738ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31662024-11-19T02:18:35.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31672024-11-19T02:18:35.752ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
31682024-11-19T02:18:35.752ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 28.723089ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
31692024-11-19T02:18:35.765ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31702024-11-19T02:18:35.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31712024-11-19T02:18:35.767ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 42.996672ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
31722024-11-19T02:18:35.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4953cc37-f8ec-47cb-936d-891be8f27bb6 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
31732024-11-19T02:18:35.895ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4953cc37-f8ec-47cb-936d-891be8f27bb6 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
31742024-11-19T02:18:35.897ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1774 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4953cc37-f8ec-47cb-936d-891be8f27bb6 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
31752024-11-19T02:18:36.919ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b006a4bb-1dc0-4caa-a6b7-1e7607620a57 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
31762024-11-19T02:18:36.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b006a4bb-1dc0-4caa-a6b7-1e7607620a57 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
31772024-11-19T02:18:36.921ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1909 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b006a4bb-1dc0-4caa-a6b7-1e7607620a57 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
31782024-11-19T02:18:37.152ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1659 local_addr = [fd00:1122:3344:101::c]:60807 method = GET remote_addr = [fd00:1122:3344:101::d]:57844 req_id = e53d1516-a590-413a-92e0-84e76683142e response_code = 200 uri = /9f0b435f-0000-451e-9dbc-dcec71543c30
31792024-11-19T02:18:37.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 5ee99138-671b-4a2a-be12-ef5bbfffbb96 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
31802024-11-19T02:18:37.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 5ee99138-671b-4a2a-be12-ef5bbfffbb96 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
31812024-11-19T02:18:37.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1930 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 5ee99138-671b-4a2a-be12-ef5bbfffbb96 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
31822024-11-19T02:18:38.966ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d2101151-d514-4e52-95e9-1c1d6160823d roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
31832024-11-19T02:18:38.966ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d2101151-d514-4e52-95e9-1c1d6160823d resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
31842024-11-19T02:18:38.968ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2514 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d2101151-d514-4e52-95e9-1c1d6160823d response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
31852024-11-19T02:18:39.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 082b6eb3-36a6-42a5-8cac-3524a75ce00a roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
31862024-11-19T02:18:39.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 082b6eb3-36a6-42a5-8cac-3524a75ce00a resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
31872024-11-19T02:18:39.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1884 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 082b6eb3-36a6-42a5-8cac-3524a75ce00a response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
31882024-11-19T02:18:41.014ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 77b667bd-07a9-4de6-9660-90abc70259c2 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
31892024-11-19T02:18:41.014ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 77b667bd-07a9-4de6-9660-90abc70259c2 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
31902024-11-19T02:18:41.016ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2098 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 77b667bd-07a9-4de6-9660-90abc70259c2 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
31912024-11-19T02:18:42.039ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 308fc30b-9e71-4542-8788-8ad3fd9f3c3f roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
31922024-11-19T02:18:42.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 308fc30b-9e71-4542-8788-8ad3fd9f3c3f resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
31932024-11-19T02:18:42.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2214 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 308fc30b-9e71-4542-8788-8ad3fd9f3c3f response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
31942024-11-19T02:18:43.063ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 78d5dbb9-bd8f-4ef7-bb96-a4116c3b4262 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
31952024-11-19T02:18:43.063ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 78d5dbb9-bd8f-4ef7-bb96-a4116c3b4262 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
31962024-11-19T02:18:43.065ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2270 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 78d5dbb9-bd8f-4ef7-bb96-a4116c3b4262 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
31972024-11-19T02:18:44.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b1271a4c-37d4-4610-8d27-e7795dcb23d1 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
31982024-11-19T02:18:44.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b1271a4c-37d4-4610-8d27-e7795dcb23d1 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
31992024-11-19T02:18:44.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2302 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b1271a4c-37d4-4610-8d27-e7795dcb23d1 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
32002024-11-19T02:18:45.113ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 807a98d5-d1a4-4235-91ea-cc8ec6fffe8e roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
32012024-11-19T02:18:45.113ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 807a98d5-d1a4-4235-91ea-cc8ec6fffe8e resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
32022024-11-19T02:18:45.115ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1885 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 807a98d5-d1a4-4235-91ea-cc8ec6fffe8e response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
32032024-11-19T02:18:45.723ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
32042024-11-19T02:18:45.723ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
32052024-11-19T02:18:45.723ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32062024-11-19T02:18:45.723ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
32072024-11-19T02:18:45.723ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
32082024-11-19T02:18:45.723ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
32092024-11-19T02:18:45.723ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
32102024-11-19T02:18:45.723ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
32112024-11-19T02:18:45.723ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
32122024-11-19T02:18:45.723ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
32132024-11-19T02:18:45.723ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
32142024-11-19T02:18:45.723ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32152024-11-19T02:18:45.723ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
32162024-11-19T02:18:45.723ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
32172024-11-19T02:18:45.723ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
32182024-11-19T02:18:45.723ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32192024-11-19T02:18:45.723ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
32202024-11-19T02:18:45.723ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-19 02:08:45.723620177 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
32212024-11-19T02:18:45.723ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
32222024-11-19T02:18:45.723ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
32232024-11-19T02:18:45.723ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
32242024-11-19T02:18:45.723ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
32252024-11-19T02:18:45.723ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
32262024-11-19T02:18:45.723ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
32272024-11-19T02:18:45.723ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
32282024-11-19T02:18:45.723ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
32292024-11-19T02:18:45.723ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32302024-11-19T02:18:45.723ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
32312024-11-19T02:18:45.723ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
32322024-11-19T02:18:45.723ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
32332024-11-19T02:18:45.723ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
32342024-11-19T02:18:45.723ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115
32352024-11-19T02:18:45.723ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
32362024-11-19T02:18:45.723ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.57\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115"}
32372024-11-19T02:18:45.723ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
32382024-11-19T02:18:45.723ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
32392024-11-19T02:18:45.723ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32402024-11-19T02:18:45.723ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
32412024-11-19T02:18:45.723ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
32422024-11-19T02:18:45.723ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32432024-11-19T02:18:45.723ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
32442024-11-19T02:18:45.723ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32452024-11-19T02:18:45.723ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
32462024-11-19T02:18:45.723ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
32472024-11-19T02:18:45.723ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
32482024-11-19T02:18:45.723ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
32492024-11-19T02:18:45.724ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32502024-11-19T02:18:45.724ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
32512024-11-19T02:18:45.724ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
32522024-11-19T02:18:45.724ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
32532024-11-19T02:18:45.724ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
32542024-11-19T02:18:45.724ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
32552024-11-19T02:18:45.724ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
32562024-11-19T02:18:45.724ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32572024-11-19T02:18:45.724ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
32582024-11-19T02:18:45.724ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
32592024-11-19T02:18:45.724ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
32602024-11-19T02:18:45.724ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
32612024-11-19T02:18:45.724ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
32622024-11-19T02:18:45.724ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
32632024-11-19T02:18:45.724ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
32642024-11-19T02:18:45.724ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
32652024-11-19T02:18:45.724ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
32662024-11-19T02:18:45.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
32672024-11-19T02:18:45.724ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32682024-11-19T02:18:45.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
32692024-11-19T02:18:45.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32702024-11-19T02:18:45.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32712024-11-19T02:18:45.724ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2d59cdb7-e3b1-4e94-afa3-f64f69928234.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a949a8d8-46c7-4423-b760-c03f98ccf638.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b190a9bf-d8b7-43c3-add4-e113c9b89870.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b190a9bf-d8b7-43c3-add4-e113c9b89870.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1423, tv_nsec: 510158141 } })
32722024-11-19T02:18:45.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
32732024-11-19T02:18:45.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32742024-11-19T02:18:45.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
32752024-11-19T02:18:45.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
32762024-11-19T02:18:45.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
32772024-11-19T02:18:45.724ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("27d1a6ca-1b76-4956-aefa-e234c7d60cd0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("91bdcbd0-987b-49c4-8200-fc3e8f332b6b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("91bdcbd0-987b-49c4-8200-fc3e8f332b6b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1423, tv_nsec: 510317612 } })
32782024-11-19T02:18:45.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
32792024-11-19T02:18:45.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32802024-11-19T02:18:45.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32812024-11-19T02:18:45.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
32822024-11-19T02:18:45.724ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
32832024-11-19T02:18:45.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32842024-11-19T02:18:45.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
32852024-11-19T02:18:45.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
32862024-11-19T02:18:45.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
32872024-11-19T02:18:45.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32882024-11-19T02:18:45.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
32892024-11-19T02:18:45.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32902024-11-19T02:18:45.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32912024-11-19T02:18:45.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
32922024-11-19T02:18:45.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
32932024-11-19T02:18:45.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
32942024-11-19T02:18:45.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32952024-11-19T02:18:45.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
32962024-11-19T02:18:45.724ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
32972024-11-19T02:18:45.724ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
32982024-11-19T02:18:45.724ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.235885ms iteration = 11 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
32992024-11-19T02:18:45.724ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
33002024-11-19T02:18:45.724ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.234925ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
33012024-11-19T02:18:45.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
33022024-11-19T02:18:45.724ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
33032024-11-19T02:18:45.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
33042024-11-19T02:18:45.725ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
33052024-11-19T02:18:45.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
33062024-11-19T02:18:45.726ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33072024-11-19T02:18:45.726ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1423, tv_nsec: 512434537 } })
33082024-11-19T02:18:45.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33092024-11-19T02:18:45.726ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
33102024-11-19T02:18:45.727ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1423, tv_nsec: 512998883 } })
33112024-11-19T02:18:45.727ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33122024-11-19T02:18:45.727ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33132024-11-19T02:18:45.727ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
33142024-11-19T02:18:45.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33152024-11-19T02:18:45.727ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.157888ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
33162024-11-19T02:18:45.728ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 4.627803ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
33172024-11-19T02:18:45.728ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-19 02:08:45.723620177 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
33182024-11-19T02:18:45.728ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.880176ms iteration = 10 status = {"expiration":"2024-11-19T02:08:45.723620177Z","pruned":[]}
33192024-11-19T02:18:45.729ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
33202024-11-19T02:18:45.729ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33212024-11-19T02:18:45.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33222024-11-19T02:18:45.733ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33232024-11-19T02:18:45.733ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33242024-11-19T02:18:45.733ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33252024-11-19T02:18:45.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
33262024-11-19T02:18:45.735ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33272024-11-19T02:18:45.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33282024-11-19T02:18:45.735ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
33292024-11-19T02:18:45.735ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33302024-11-19T02:18:45.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33312024-11-19T02:18:45.736ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
33322024-11-19T02:18:45.736ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
33332024-11-19T02:18:45.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
33342024-11-19T02:18:45.737ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33352024-11-19T02:18:45.739ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 15.530298ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
33362024-11-19T02:18:45.739ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
33372024-11-19T02:18:45.739ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
33382024-11-19T02:18:45.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
33392024-11-19T02:18:45.740ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
33402024-11-19T02:18:45.740ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
33412024-11-19T02:18:45.740ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
33422024-11-19T02:18:45.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
33432024-11-19T02:18:45.744ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
33442024-11-19T02:18:45.744ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
33452024-11-19T02:18:45.744ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 20.09771ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
33462024-11-19T02:18:45.744ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33472024-11-19T02:18:45.744ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33482024-11-19T02:18:45.748ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
33492024-11-19T02:18:45.748ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
33502024-11-19T02:18:45.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
33512024-11-19T02:18:45.750ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
33522024-11-19T02:18:45.750ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
33532024-11-19T02:18:45.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
33542024-11-19T02:18:45.750ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33552024-11-19T02:18:45.752ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
33562024-11-19T02:18:45.752ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
33572024-11-19T02:18:45.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
33582024-11-19T02:18:45.753ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33592024-11-19T02:18:45.757ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33602024-11-19T02:18:45.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33612024-11-19T02:18:45.757ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
33622024-11-19T02:18:45.757ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
33632024-11-19T02:18:45.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
33642024-11-19T02:18:45.758ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33652024-11-19T02:18:45.760ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33662024-11-19T02:18:45.761ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1423, tv_nsec: 547572319 } })
33672024-11-19T02:18:45.761ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
33682024-11-19T02:18:45.763ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
33692024-11-19T02:18:45.763ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33702024-11-19T02:18:45.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33712024-11-19T02:18:45.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
33722024-11-19T02:18:45.765ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
33732024-11-19T02:18:45.765ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
33742024-11-19T02:18:45.765ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
33752024-11-19T02:18:45.765ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33762024-11-19T02:18:45.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33772024-11-19T02:18:45.768ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33782024-11-19T02:18:45.769ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33792024-11-19T02:18:45.773ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
33802024-11-19T02:18:45.773ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33812024-11-19T02:18:45.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33822024-11-19T02:18:45.773ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
33832024-11-19T02:18:45.773ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33842024-11-19T02:18:45.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33852024-11-19T02:18:45.780ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
33862024-11-19T02:18:45.780ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = af79c7eb-bc4d-42f8-9217-8b35affeeebb dns_zone_name = oxide.test found_so_far = 0 version = 2
33872024-11-19T02:18:45.780ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33882024-11-19T02:18:45.781ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
33892024-11-19T02:18:45.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33902024-11-19T02:18:45.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
33912024-11-19T02:18:45.784ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 61.106099ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
33922024-11-19T02:18:45.784ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33932024-11-19T02:18:45.785ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
33942024-11-19T02:18:45.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
33952024-11-19T02:18:45.786ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33962024-11-19T02:18:45.789ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
33972024-11-19T02:18:45.789ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33982024-11-19T02:18:45.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33992024-11-19T02:18:45.789ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34002024-11-19T02:18:45.791ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34012024-11-19T02:18:45.791ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
34022024-11-19T02:18:45.791ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34032024-11-19T02:18:45.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34042024-11-19T02:18:45.792ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
34052024-11-19T02:18:45.792ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34062024-11-19T02:18:45.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34072024-11-19T02:18:45.793ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
34082024-11-19T02:18:45.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
34092024-11-19T02:18:45.794ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34102024-11-19T02:18:45.794ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
34112024-11-19T02:18:45.794ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34122024-11-19T02:18:45.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34132024-11-19T02:18:45.796ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34142024-11-19T02:18:45.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34152024-11-19T02:18:45.796ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = af79c7eb-bc4d-42f8-9217-8b35affeeebb dns_zone_name = oxide.test found_so_far = 1 version = 2
34162024-11-19T02:18:45.796ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
34172024-11-19T02:18:45.796ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-19 02:10:28.769117 UTC dns_group = external generation = 2
34182024-11-19T02:18:45.796ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 73.3126ms iteration = 11 status = {"generation":2}
34192024-11-19T02:18:45.797ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 73.576292ms iteration = 5 status = {"nsuccess":5}
34202024-11-19T02:18:45.797ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34212024-11-19T02:18:45.797ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34222024-11-19T02:18:45.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34232024-11-19T02:18:45.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34242024-11-19T02:18:45.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34252024-11-19T02:18:45.798ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
34262024-11-19T02:18:45.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
34272024-11-19T02:18:45.798ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 74.854457ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
34282024-11-19T02:18:45.798ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34292024-11-19T02:18:45.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34302024-11-19T02:18:45.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34312024-11-19T02:18:45.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34322024-11-19T02:18:45.799ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 75.519074ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34332024-11-19T02:18:45.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34342024-11-19T02:18:45.801ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
34352024-11-19T02:18:45.801ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
34362024-11-19T02:18:45.801ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 77.394386ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
34372024-11-19T02:18:45.803ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
34382024-11-19T02:18:45.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34392024-11-19T02:18:45.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34402024-11-19T02:18:45.805ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 81.322582ms iteration = 19 status = {"errors":[],"records_set_to_done":[]}
34412024-11-19T02:18:45.807ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34422024-11-19T02:18:45.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
34432024-11-19T02:18:45.814ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34442024-11-19T02:18:45.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34452024-11-19T02:18:45.814ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
34462024-11-19T02:18:45.814ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
34472024-11-19T02:18:45.814ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
34482024-11-19T02:18:45.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
34492024-11-19T02:18:45.815ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34502024-11-19T02:18:45.817ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
34512024-11-19T02:18:45.817ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 93.49117ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
34522024-11-19T02:18:45.817ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
34532024-11-19T02:18:45.817ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34542024-11-19T02:18:45.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34552024-11-19T02:18:45.818ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
34562024-11-19T02:18:45.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
34572024-11-19T02:18:45.820ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
34582024-11-19T02:18:45.820ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 96.762167ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
34592024-11-19T02:18:45.826ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34602024-11-19T02:18:45.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34612024-11-19T02:18:45.830ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34622024-11-19T02:18:45.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34632024-11-19T02:18:45.832ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34642024-11-19T02:18:45.836ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: ffe74824-0c08-48e1-a755-fb123e8dc181, lookup_type: ById(ffe74824-0c08-48e1-a755-fb123e8dc181) } result = Ok(())
34652024-11-19T02:18:45.836ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34662024-11-19T02:18:45.836ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 112.507158ms iteration = 19 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
34672024-11-19T02:18:45.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34682024-11-19T02:18:45.837ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 114.021615ms iteration = 19 status = 0
34692024-11-19T02:18:45.839ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34702024-11-19T02:18:45.841ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
34712024-11-19T02:18:45.841ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34722024-11-19T02:18:45.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34732024-11-19T02:18:45.850ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
34742024-11-19T02:18:45.850ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
34752024-11-19T02:18:45.850ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
34762024-11-19T02:18:45.850ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34772024-11-19T02:18:45.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34782024-11-19T02:18:45.852ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34792024-11-19T02:18:45.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
34802024-11-19T02:18:45.855ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34812024-11-19T02:18:45.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34822024-11-19T02:18:45.856ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 132.310295ms iteration = 22 status = {"physical_disks_added":0}
34832024-11-19T02:18:45.857ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
34842024-11-19T02:18:45.857ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
34852024-11-19T02:18:45.857ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 133.64048ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
34862024-11-19T02:18:45.872ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-19T02:09:41.910054Z, time_modified: 2024-11-19T02:09:41.910054Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 78638afa-e975-44a9-b764-0afec18d156f, db_silo: Silo { identity: SiloIdentity { id: 78638afa-e975-44a9-b764-0afec18d156f, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-19T02:10:28.623188Z, time_modified: 2024-11-19T02:10:28.623188Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "fe94815f3f5502a309deafc95cd58d4fe61e984b7bd8ad11309589068beb64f5" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 78638afa-e975-44a9-b764-0afec18d156f, db_silo: Silo { identity: SiloIdentity { id: 78638afa-e975-44a9-b764-0afec18d156f, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-19T02:10:28.623188Z, time_modified: 2024-11-19T02:10:28.623188Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "fe94815f3f5502a309deafc95cd58d4fe61e984b7bd8ad11309589068beb64f5" }] }) }
34872024-11-19T02:18:45.872ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 149.334229ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"78638afa-e975-44a9-b764-0afec18d156f","tls_certs":["fe94815f3f5502a309deafc95cd58d4fe61e984b7bd8ad11309589068beb64f5"]}},"default_endpoint":{"silo_id":"78638afa-e975-44a9-b764-0afec18d156f","tls_certs":["fe94815f3f5502a309deafc95cd58d4fe61e984b7bd8ad11309589068beb64f5"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
34882024-11-19T02:18:45.873ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34892024-11-19T02:18:45.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34902024-11-19T02:18:45.880ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
34912024-11-19T02:18:45.881ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34922024-11-19T02:18:45.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34932024-11-19T02:18:45.883ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34942024-11-19T02:18:45.886ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
34952024-11-19T02:18:45.886ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34962024-11-19T02:18:45.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34972024-11-19T02:18:45.888ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
34982024-11-19T02:18:45.888ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34992024-11-19T02:18:45.888ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
35002024-11-19T02:18:45.888ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 164.328891ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
35012024-11-19T02:18:45.889ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
35022024-11-19T02:18:45.889ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35032024-11-19T02:18:45.889ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d43da9a-c857-4628-a1d0-0d9770c7aee0", "content-length": "26", "date": "Tue, 19 Nov 2024 02:18:45 GMT"} })
35042024-11-19T02:18:45.890ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35052024-11-19T02:18:45.890ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
35062024-11-19T02:18:45.890ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35072024-11-19T02:18:45.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35082024-11-19T02:18:45.892ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
35092024-11-19T02:18:45.894ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
35102024-11-19T02:18:45.894ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 8c04fa4d-031f-4603-9b0e-246b45d39276 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
35112024-11-19T02:18:45.894ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35122024-11-19T02:18:45.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35132024-11-19T02:18:45.896ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35142024-11-19T02:18:45.899ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
35152024-11-19T02:18:45.899ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35162024-11-19T02:18:45.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35172024-11-19T02:18:45.902ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 8c04fa4d-031f-4603-9b0e-246b45d39276 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
35182024-11-19T02:18:45.902ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
35192024-11-19T02:18:45.902ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-19 02:10:27.714570 UTC dns_group = internal generation = 1
35202024-11-19T02:18:45.902ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 178.518203ms iteration = 11 status = {"generation":1}
35212024-11-19T02:18:45.979ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 zone_address = fd00:1122:3344:101::2
35222024-11-19T02:18:45.979ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35232024-11-19T02:18:45.979ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b7478001-bc68-43c6-b8ae-212d7bb4c1b2", "content-length": "26", "date": "Tue, 19 Nov 2024 02:18:45 GMT"} })
35242024-11-19T02:18:45.980ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35252024-11-19T02:18:45.981ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
35262024-11-19T02:18:45.993ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
35272024-11-19T02:18:45.993ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35282024-11-19T02:18:45.993ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "97555e90-faf8-437d-b0a9-55b0faf0228b", "content-length": "26", "date": "Tue, 19 Nov 2024 02:18:45 GMT"} })
35292024-11-19T02:18:45.993ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35302024-11-19T02:18:45.996ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
35312024-11-19T02:18:46.048ZINFOnexus (BackgroundTasks): VPC route manager sled ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
35322024-11-19T02:18:46.048ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
35332024-11-19T02:18:46.048ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "65395fd9-d188-42de-b282-b35fe0ba2884", "content-length": "372", "date": "Tue, 19 Nov 2024 02:18:46 GMT"} })
35342024-11-19T02:18:46.048ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35352024-11-19T02:18:46.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35362024-11-19T02:18:46.073ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
35372024-11-19T02:18:46.073ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
35382024-11-19T02:18:46.073ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3522cbce-673d-450b-ab25-5e345d6cdbe1", "date": "Tue, 19 Nov 2024 02:18:46 GMT"} })
35392024-11-19T02:18:46.073ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35402024-11-19T02:18:46.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35412024-11-19T02:18:46.085ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35422024-11-19T02:18:46.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35432024-11-19T02:18:46.120ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
35442024-11-19T02:18:46.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4065c354-604c-46b2-97e8-90accd689af4 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
35452024-11-19T02:18:46.138ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4065c354-604c-46b2-97e8-90accd689af4 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
35462024-11-19T02:18:46.149ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
35472024-11-19T02:18:46.149ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "b10465dc-068b-4743-87fb-39cd7de7ca7a", "content-length": "1", "date": "Tue, 19 Nov 2024 02:18:45 GMT"} })
35482024-11-19T02:18:46.151ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
35492024-11-19T02:18:46.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
35502024-11-19T02:18:46.193ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 470.193822ms iteration = 19 status = {}
35512024-11-19T02:18:46.211ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
35522024-11-19T02:18:46.212ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "cdb58c58-92ce-4b3a-90ca-4100d6b1fdb0", "date": "Tue, 19 Nov 2024 02:18:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
35532024-11-19T02:18:46.212ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
35542024-11-19T02:18:46.212ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
35552024-11-19T02:18:46.213ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "64c55f6d-97af-4d35-9f50-01d68d06d878", "content-length": "691", "date": "Tue, 19 Nov 2024 02:18:46 GMT"} })
35562024-11-19T02:18:46.213ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
35572024-11-19T02:18:46.213ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
35582024-11-19T02:18:46.213ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
35592024-11-19T02:18:46.215ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78267 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4065c354-604c-46b2-97e8-90accd689af4 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
35602024-11-19T02:18:46.215ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "9436b30b-6a8e-419a-980c-a5febfc79738", "date": "Tue, 19 Nov 2024 02:18:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
35612024-11-19T02:18:46.215ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
35622024-11-19T02:18:46.216ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 492.343405ms iteration = 19 status = {}
35632024-11-19T02:18:46.217ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 493.575609ms iteration = 19 status = null
35642024-11-19T02:18:46.217ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35652024-11-19T02:18:46.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35662024-11-19T02:18:46.218ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
35672024-11-19T02:18:46.218ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 495.143917ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
35682024-11-19T02:18:46.223ZINFOnexus (BackgroundTasks): VPC route manager sled ffe74824-0c08-48e1-a755-fb123e8dc181 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
35692024-11-19T02:18:46.223ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
35702024-11-19T02:18:46.227ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "afe2c789-5d55-4e2a-b802-a9c87133aeb1", "date": "Tue, 19 Nov 2024 02:18:46 GMT"} })
35712024-11-19T02:18:46.230ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 506.612188ms iteration = 20 status = {}
35722024-11-19T02:18:46.253ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
35732024-11-19T02:18:46.254ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "dc56b85b-ac69-4022-b9c9-6e1e685d1635", "date": "Tue, 19 Nov 2024 02:18:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
35742024-11-19T02:18:46.254ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
35752024-11-19T02:18:46.255ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "2ca241b3-a3ea-4259-b115-2e94e4c025fb", "date": "Tue, 19 Nov 2024 02:18:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
35762024-11-19T02:18:46.255ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
35772024-11-19T02:18:46.258ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "7a888a00-7b87-494f-a2d7-a823583647f9", "date": "Tue, 19 Nov 2024 02:18:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
35782024-11-19T02:18:46.258ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
35792024-11-19T02:18:46.260ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
35802024-11-19T02:18:46.260ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 537.412301ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
35812024-11-19T02:18:46.297ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35822024-11-19T02:18:46.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35832024-11-19T02:18:46.300ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 20bc3881-e2ee-4d8d-b84b-b0c1e478721f, rack_id: a894e92e-d765-4f15-b6b7-cb9ca46d1860, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8597d802-6d4d-4493-88de-333a1f340c20) } rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0
35842024-11-19T02:18:46.300ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35852024-11-19T02:18:46.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35862024-11-19T02:18:46.309ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
35872024-11-19T02:18:46.310ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "fcfcc871-6981-499d-abb0-3900d97e9e43", "content-length": "134", "date": "Tue, 19 Nov 2024 02:18:45 GMT"} })
35882024-11-19T02:18:46.310ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
35892024-11-19T02:18:46.310ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8597d802-6d4d-4493-88de-333a1f340c20
35902024-11-19T02:18:46.310ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
35912024-11-19T02:18:46.310ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
35922024-11-19T02:18:46.310ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35932024-11-19T02:18:46.310ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35942024-11-19T02:18:46.310ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35952024-11-19T02:18:46.310ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
35962024-11-19T02:18:46.310ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35972024-11-19T02:18:46.310ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
35982024-11-19T02:18:46.310ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
35992024-11-19T02:18:46.310ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36002024-11-19T02:18:46.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36012024-11-19T02:18:46.313ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
36022024-11-19T02:18:46.313ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7558b76f-3ae5-42bf-8ef4-2ec8fb8b61b5", "content-length": "2", "date": "Tue, 19 Nov 2024 02:18:45 GMT"} })
36032024-11-19T02:18:46.313ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
36042024-11-19T02:18:46.313ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e4071ac-b0c4-4803-80ab-151f35988af2", "content-length": "52", "date": "Tue, 19 Nov 2024 02:18:45 GMT"} })
36052024-11-19T02:18:46.313ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0
36062024-11-19T02:18:46.313ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
36072024-11-19T02:18:46.465ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4cd4a12c-44e3-43a9-b93f-13183d6a409b", "date": "Tue, 19 Nov 2024 02:18:46 GMT"} })
36082024-11-19T02:18:46.465ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch = Switch0
36092024-11-19T02:18:46.465ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
36102024-11-19T02:18:46.466ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "1773b688-593d-4129-9ed1-125fc000bdc5", "content-length": "682", "date": "Tue, 19 Nov 2024 02:18:46 GMT"} })
36112024-11-19T02:18:46.466ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36122024-11-19T02:18:46.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36132024-11-19T02:18:46.471ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36142024-11-19T02:18:46.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36152024-11-19T02:18:46.482ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36162024-11-19T02:18:46.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36172024-11-19T02:18:46.486ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36182024-11-19T02:18:46.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36192024-11-19T02:18:46.496ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 772.597143ms iteration = 19 status = {}
36202024-11-19T02:18:46.906ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = e0864686-73ac-452f-9803-ced317dccd1f roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
36212024-11-19T02:18:46.906ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = e0864686-73ac-452f-9803-ced317dccd1f resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
36222024-11-19T02:18:46.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2832 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = e0864686-73ac-452f-9803-ced317dccd1f response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
36232024-11-19T02:18:47.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 2a8e0a08-c042-432c-9afa-513df573a9b3 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
36242024-11-19T02:18:47.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 2a8e0a08-c042-432c-9afa-513df573a9b3 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
36252024-11-19T02:18:47.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2288 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 2a8e0a08-c042-432c-9afa-513df573a9b3 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
36262024-11-19T02:18:48.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 46e04aa8-680f-498c-826b-62b26080a581 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
36272024-11-19T02:18:48.268ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 46e04aa8-680f-498c-826b-62b26080a581 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
36282024-11-19T02:18:48.270ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2041 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 46e04aa8-680f-498c-826b-62b26080a581 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
36292024-11-19T02:18:49.296ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 8293506e-bfd3-4589-9015-f317fa364d3b roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
36302024-11-19T02:18:49.296ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 8293506e-bfd3-4589-9015-f317fa364d3b resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
36312024-11-19T02:18:49.298ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2044 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 8293506e-bfd3-4589-9015-f317fa364d3b response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
36322024-11-19T02:18:50.319ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 13ba8956-f0b7-4701-9415-422d0d02fb77 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
36332024-11-19T02:18:50.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 13ba8956-f0b7-4701-9415-422d0d02fb77 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
36342024-11-19T02:18:50.321ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2126 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 13ba8956-f0b7-4701-9415-422d0d02fb77 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
36352024-11-19T02:18:51.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 55d34678-30c5-4d5d-bc4b-cf5b11fb8c39 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
36362024-11-19T02:18:51.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 55d34678-30c5-4d5d-bc4b-cf5b11fb8c39 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
36372024-11-19T02:18:51.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2193 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 55d34678-30c5-4d5d-bc4b-cf5b11fb8c39 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
36382024-11-19T02:18:52.152ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1572 local_addr = [fd00:1122:3344:101::c]:60807 method = GET remote_addr = [fd00:1122:3344:101::d]:57844 req_id = a5b71474-b451-403f-9c7e-7d32379c9507 response_code = 200 uri = /9f0b435f-0000-451e-9dbc-dcec71543c30
36392024-11-19T02:18:52.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 8814b894-d372-4388-8c78-0b3d14936c35 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
36402024-11-19T02:18:52.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 8814b894-d372-4388-8c78-0b3d14936c35 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
36412024-11-19T02:18:52.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1757 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 8814b894-d372-4388-8c78-0b3d14936c35 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
36422024-11-19T02:18:53.390ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 293879e6-d783-4cdf-9731-80c518093afd roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
36432024-11-19T02:18:53.390ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 293879e6-d783-4cdf-9731-80c518093afd resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
36442024-11-19T02:18:53.392ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2262 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 293879e6-d783-4cdf-9731-80c518093afd response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
36452024-11-19T02:18:54.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 1858644f-e54f-4448-8dce-f8f31ba5be16 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
36462024-11-19T02:18:54.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 1858644f-e54f-4448-8dce-f8f31ba5be16 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
36472024-11-19T02:18:54.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2292 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 1858644f-e54f-4448-8dce-f8f31ba5be16 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
36482024-11-19T02:18:55.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b520a445-117e-4cfd-a049-7c3de3d543d3 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
36492024-11-19T02:18:55.439ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b520a445-117e-4cfd-a049-7c3de3d543d3 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
36502024-11-19T02:18:55.441ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2897 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b520a445-117e-4cfd-a049-7c3de3d543d3 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
36512024-11-19T02:18:55.724ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
36522024-11-19T02:18:55.724ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
36532024-11-19T02:18:55.724ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36542024-11-19T02:18:55.724ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36552024-11-19T02:18:55.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36562024-11-19T02:18:55.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36572024-11-19T02:18:55.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36582024-11-19T02:18:55.729ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
36592024-11-19T02:18:55.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36602024-11-19T02:18:55.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36612024-11-19T02:18:55.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36622024-11-19T02:18:55.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36632024-11-19T02:18:55.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36642024-11-19T02:18:55.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
36652024-11-19T02:18:55.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36662024-11-19T02:18:55.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36672024-11-19T02:18:55.744ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
36682024-11-19T02:18:55.744ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.707037ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
36692024-11-19T02:18:55.753ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36702024-11-19T02:18:55.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36712024-11-19T02:18:55.755ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.506951ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
36722024-11-19T02:18:56.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = df015ca0-bb10-4e34-a152-15306f8760f0 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
36732024-11-19T02:18:56.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = df015ca0-bb10-4e34-a152-15306f8760f0 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
36742024-11-19T02:18:56.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2024 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = df015ca0-bb10-4e34-a152-15306f8760f0 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
36752024-11-19T02:18:57.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = d6f0bf41-e819-4f1a-9915-722b8417ddb8 roles = RoleSet { roles: {} } uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?sort_by=id_ascending
36762024-11-19T02:18:57.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = d6f0bf41-e819-4f1a-9915-722b8417ddb8 resource = Database result = Ok(()) uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?sort_by=id_ascending
36772024-11-19T02:18:57.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3477 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = d6f0bf41-e819-4f1a-9915-722b8417ddb8 response_code = 200 uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?sort_by=id_ascending
36782024-11-19T02:18:57.147ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = 6037eba8-910d-473b-991b-d9e23e34fcc0 roles = RoleSet { roles: {} } uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZmU3NDgyNC0wYzA4LTQ4ZTEtYTc1NS1mYjEyM2U4ZGMxODEifX0%3D
36792024-11-19T02:18:57.148ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = 6037eba8-910d-473b-991b-d9e23e34fcc0 resource = Database result = Ok(()) uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZmU3NDgyNC0wYzA4LTQ4ZTEtYTc1NS1mYjEyM2U4ZGMxODEifX0%3D
36802024-11-19T02:18:57.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2860 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = 6037eba8-910d-473b-991b-d9e23e34fcc0 response_code = 200 uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZmU3NDgyNC0wYzA4LTQ4ZTEtYTc1NS1mYjEyM2U4ZGMxODEifX0%3D
36812024-11-19T02:18:57.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 1fda5c57-4e14-41dd-baf5-758f458df6c6 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
36822024-11-19T02:18:57.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 1fda5c57-4e14-41dd-baf5-758f458df6c6 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
36832024-11-19T02:18:57.486ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2338 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 1fda5c57-4e14-41dd-baf5-758f458df6c6 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
36842024-11-19T02:18:58.508ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c75d0d67-f029-4bc5-a843-7b28d3de2b94 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
36852024-11-19T02:18:58.509ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c75d0d67-f029-4bc5-a843-7b28d3de2b94 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
36862024-11-19T02:18:58.510ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1926 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c75d0d67-f029-4bc5-a843-7b28d3de2b94 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
36872024-11-19T02:18:59.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a7531c82-304e-485f-9a1c-a67bc284a955 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
36882024-11-19T02:18:59.533ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a7531c82-304e-485f-9a1c-a67bc284a955 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
36892024-11-19T02:18:59.534ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1958 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a7531c82-304e-485f-9a1c-a67bc284a955 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
36902024-11-19T02:19:00.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 170eb788-19e3-4041-a0d2-411ac492b36e roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
36912024-11-19T02:19:00.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 170eb788-19e3-4041-a0d2-411ac492b36e resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
36922024-11-19T02:19:00.557ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1707 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 170eb788-19e3-4041-a0d2-411ac492b36e response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
36932024-11-19T02:19:01.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d0219938-cd19-434f-8b8e-3216aa104984 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
36942024-11-19T02:19:01.580ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d0219938-cd19-434f-8b8e-3216aa104984 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
36952024-11-19T02:19:01.581ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2181 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d0219938-cd19-434f-8b8e-3216aa104984 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
36962024-11-19T02:19:02.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6807fbb6-110d-4db8-92b6-8d08014dfd6d roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
36972024-11-19T02:19:02.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6807fbb6-110d-4db8-92b6-8d08014dfd6d resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
36982024-11-19T02:19:02.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1995 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6807fbb6-110d-4db8-92b6-8d08014dfd6d response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
36992024-11-19T02:19:03.624ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c462e91f-da94-40c6-a8e2-3d9fb94bc7ef roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
37002024-11-19T02:19:03.624ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c462e91f-da94-40c6-a8e2-3d9fb94bc7ef resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
37012024-11-19T02:19:03.626ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1813 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c462e91f-da94-40c6-a8e2-3d9fb94bc7ef response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
37022024-11-19T02:19:04.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 93f65ab7-27b6-4cf8-88aa-ead39c122944 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
37032024-11-19T02:19:04.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 93f65ab7-27b6-4cf8-88aa-ead39c122944 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
37042024-11-19T02:19:04.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2213 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 93f65ab7-27b6-4cf8-88aa-ead39c122944 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
37052024-11-19T02:19:05.671ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 5d940e01-a2ae-4230-ad15-e27eebc89217 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
37062024-11-19T02:19:05.672ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 5d940e01-a2ae-4230-ad15-e27eebc89217 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
37072024-11-19T02:19:05.674ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2899 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 5d940e01-a2ae-4230-ad15-e27eebc89217 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
37082024-11-19T02:19:05.724ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
37092024-11-19T02:19:05.724ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
37102024-11-19T02:19:05.724ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37112024-11-19T02:19:05.724ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37122024-11-19T02:19:05.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37132024-11-19T02:19:05.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37142024-11-19T02:19:05.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37152024-11-19T02:19:05.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37162024-11-19T02:19:05.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37172024-11-19T02:19:05.728ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.123767ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37182024-11-19T02:19:05.730ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37192024-11-19T02:19:05.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37202024-11-19T02:19:05.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37212024-11-19T02:19:05.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37222024-11-19T02:19:05.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37232024-11-19T02:19:05.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37242024-11-19T02:19:05.737ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
37252024-11-19T02:19:05.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37262024-11-19T02:19:05.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37272024-11-19T02:19:05.746ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
37282024-11-19T02:19:05.746ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.631308ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
37292024-11-19T02:19:06.697ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 895c0cd4-7d6c-4f07-8733-560736192a7b roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
37302024-11-19T02:19:06.698ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 895c0cd4-7d6c-4f07-8733-560736192a7b resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
37312024-11-19T02:19:06.699ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2267 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 895c0cd4-7d6c-4f07-8733-560736192a7b response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
37322024-11-19T02:19:07.153ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1427 local_addr = [fd00:1122:3344:101::c]:60807 method = GET remote_addr = [fd00:1122:3344:101::d]:57844 req_id = b5fe36b8-1e20-438f-80ef-802dd22842cb response_code = 200 uri = /9f0b435f-0000-451e-9dbc-dcec71543c30
37332024-11-19T02:19:07.720ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9d4462b0-3c89-45d2-9f3d-859dd5b38bc1 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
37342024-11-19T02:19:07.721ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9d4462b0-3c89-45d2-9f3d-859dd5b38bc1 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
37352024-11-19T02:19:07.722ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2025 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9d4462b0-3c89-45d2-9f3d-859dd5b38bc1 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
37362024-11-19T02:19:08.743ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ce9b6cb6-49e2-4bdb-b0d8-a062a6a5522a roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
37372024-11-19T02:19:08.743ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ce9b6cb6-49e2-4bdb-b0d8-a062a6a5522a resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
37382024-11-19T02:19:08.745ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1912 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ce9b6cb6-49e2-4bdb-b0d8-a062a6a5522a response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
37392024-11-19T02:19:09.768ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 5942b34d-c7be-4714-a4f6-a68a70cbd34a roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
37402024-11-19T02:19:09.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 5942b34d-c7be-4714-a4f6-a68a70cbd34a resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
37412024-11-19T02:19:09.770ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2045 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 5942b34d-c7be-4714-a4f6-a68a70cbd34a response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
37422024-11-19T02:19:10.791ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3dac67a9-c39e-46e9-b446-6c4d12d9c786 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
37432024-11-19T02:19:10.792ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3dac67a9-c39e-46e9-b446-6c4d12d9c786 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
37442024-11-19T02:19:10.793ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2099 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3dac67a9-c39e-46e9-b446-6c4d12d9c786 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
37452024-11-19T02:19:11.816ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 85ac9f6b-1526-43c4-89d1-aa467dd78518 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
37462024-11-19T02:19:11.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 85ac9f6b-1526-43c4-89d1-aa467dd78518 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
37472024-11-19T02:19:11.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2036 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 85ac9f6b-1526-43c4-89d1-aa467dd78518 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
37482024-11-19T02:19:12.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = 04b13ccc-3a66-4a83-b832-ff7fc2676798 roles = RoleSet { roles: {} } uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?sort_by=id_ascending
37492024-11-19T02:19:12.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = 04b13ccc-3a66-4a83-b832-ff7fc2676798 resource = Database result = Ok(()) uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?sort_by=id_ascending
37502024-11-19T02:19:12.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3630 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = 04b13ccc-3a66-4a83-b832-ff7fc2676798 response_code = 200 uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?sort_by=id_ascending
37512024-11-19T02:19:12.148ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = cb9d6f3a-95f0-4bf0-ac58-a0fd074846b3 roles = RoleSet { roles: {} } uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZmU3NDgyNC0wYzA4LTQ4ZTEtYTc1NS1mYjEyM2U4ZGMxODEifX0%3D
37522024-11-19T02:19:12.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = cb9d6f3a-95f0-4bf0-ac58-a0fd074846b3 resource = Database result = Ok(()) uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZmU3NDgyNC0wYzA4LTQ4ZTEtYTc1NS1mYjEyM2U4ZGMxODEifX0%3D
37532024-11-19T02:19:12.151ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2336 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = cb9d6f3a-95f0-4bf0-ac58-a0fd074846b3 response_code = 200 uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZmU3NDgyNC0wYzA4LTQ4ZTEtYTc1NS1mYjEyM2U4ZGMxODEifX0%3D
37542024-11-19T02:19:12.839ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 811f667f-e002-48a0-850b-9474a4e4039d roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
37552024-11-19T02:19:12.839ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 811f667f-e002-48a0-850b-9474a4e4039d resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
37562024-11-19T02:19:12.841ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2259 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 811f667f-e002-48a0-850b-9474a4e4039d response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
37572024-11-19T02:19:13.862ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c5d51955-a837-4228-a9e2-f8d96fb7e36b roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
37582024-11-19T02:19:13.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c5d51955-a837-4228-a9e2-f8d96fb7e36b resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
37592024-11-19T02:19:13.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2448 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c5d51955-a837-4228-a9e2-f8d96fb7e36b response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
37602024-11-19T02:19:14.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b803162e-ac31-4391-8c00-e6b0a72698b7 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
37612024-11-19T02:19:14.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b803162e-ac31-4391-8c00-e6b0a72698b7 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
37622024-11-19T02:19:14.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2230 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b803162e-ac31-4391-8c00-e6b0a72698b7 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
37632024-11-19T02:19:15.723ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
37642024-11-19T02:19:15.723ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
37652024-11-19T02:19:15.723ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
37662024-11-19T02:19:15.723ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
37672024-11-19T02:19:15.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
37682024-11-19T02:19:15.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
37692024-11-19T02:19:15.724ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
37702024-11-19T02:19:15.724ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
37712024-11-19T02:19:15.724ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37722024-11-19T02:19:15.724ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
37732024-11-19T02:19:15.724ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
37742024-11-19T02:19:15.724ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
37752024-11-19T02:19:15.724ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37762024-11-19T02:19:15.724ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
37772024-11-19T02:19:15.724ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
37782024-11-19T02:19:15.724ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
37792024-11-19T02:19:15.724ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
37802024-11-19T02:19:15.724ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37812024-11-19T02:19:15.724ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37822024-11-19T02:19:15.724ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
37832024-11-19T02:19:15.724ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
37842024-11-19T02:19:15.724ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
37852024-11-19T02:19:15.724ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37862024-11-19T02:19:15.724ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
37872024-11-19T02:19:15.724ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
37882024-11-19T02:19:15.724ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
37892024-11-19T02:19:15.724ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37902024-11-19T02:19:15.724ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
37912024-11-19T02:19:15.724ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
37922024-11-19T02:19:15.724ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
37932024-11-19T02:19:15.724ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
37942024-11-19T02:19:15.724ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37952024-11-19T02:19:15.724ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
37962024-11-19T02:19:15.724ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
37972024-11-19T02:19:15.724ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
37982024-11-19T02:19:15.724ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
37992024-11-19T02:19:15.724ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
38002024-11-19T02:19:15.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38012024-11-19T02:19:15.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
38022024-11-19T02:19:15.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38032024-11-19T02:19:15.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38042024-11-19T02:19:15.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38052024-11-19T02:19:15.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
38062024-11-19T02:19:15.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38072024-11-19T02:19:15.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38082024-11-19T02:19:15.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
38092024-11-19T02:19:15.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
38102024-11-19T02:19:15.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
38112024-11-19T02:19:15.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
38122024-11-19T02:19:15.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38132024-11-19T02:19:15.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
38142024-11-19T02:19:15.726ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1453, tv_nsec: 511822590 } })
38152024-11-19T02:19:15.726ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1453, tv_nsec: 511820320 } })
38162024-11-19T02:19:15.726ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38172024-11-19T02:19:15.726ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
38182024-11-19T02:19:15.726ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
38192024-11-19T02:19:15.727ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.54113ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
38202024-11-19T02:19:15.727ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38212024-11-19T02:19:15.728ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38222024-11-19T02:19:15.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38232024-11-19T02:19:15.728ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
38242024-11-19T02:19:15.728ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38252024-11-19T02:19:15.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38262024-11-19T02:19:15.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38272024-11-19T02:19:15.730ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
38282024-11-19T02:19:15.731ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38292024-11-19T02:19:15.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
38302024-11-19T02:19:15.731ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
38312024-11-19T02:19:15.731ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38322024-11-19T02:19:15.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38332024-11-19T02:19:15.732ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 8.562478ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
38342024-11-19T02:19:15.733ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 8.993813ms iteration = 20 status = {"errors":[],"records_set_to_done":[]}
38352024-11-19T02:19:15.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
38362024-11-19T02:19:15.733ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38372024-11-19T02:19:15.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38382024-11-19T02:19:15.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38392024-11-19T02:19:15.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38402024-11-19T02:19:15.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38412024-11-19T02:19:15.735ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
38422024-11-19T02:19:15.735ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
38432024-11-19T02:19:15.735ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
38442024-11-19T02:19:15.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
38452024-11-19T02:19:15.736ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38462024-11-19T02:19:15.736ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38472024-11-19T02:19:15.736ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 12.785586ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38482024-11-19T02:19:15.737ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38492024-11-19T02:19:15.739ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
38502024-11-19T02:19:15.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
38512024-11-19T02:19:15.739ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
38522024-11-19T02:19:15.739ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
38532024-11-19T02:19:15.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
38542024-11-19T02:19:15.740ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
38552024-11-19T02:19:15.740ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38562024-11-19T02:19:15.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
38572024-11-19T02:19:15.740ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38582024-11-19T02:19:15.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38592024-11-19T02:19:15.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38602024-11-19T02:19:15.740ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 16.810323ms iteration = 20 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
38612024-11-19T02:19:15.742ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38622024-11-19T02:19:15.742ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38632024-11-19T02:19:15.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38642024-11-19T02:19:15.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38652024-11-19T02:19:15.743ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1453, tv_nsec: 528655182 } })
38662024-11-19T02:19:15.743ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 18.868846ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
38672024-11-19T02:19:15.743ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
38682024-11-19T02:19:15.743ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
38692024-11-19T02:19:15.743ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
38702024-11-19T02:19:15.743ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
38712024-11-19T02:19:15.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
38722024-11-19T02:19:15.744ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38732024-11-19T02:19:15.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38742024-11-19T02:19:15.745ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38752024-11-19T02:19:15.747ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
38762024-11-19T02:19:15.747ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 23.412568ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
38772024-11-19T02:19:15.748ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
38782024-11-19T02:19:15.748ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38792024-11-19T02:19:15.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38802024-11-19T02:19:15.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
38812024-11-19T02:19:15.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
38822024-11-19T02:19:15.760ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
38832024-11-19T02:19:15.760ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 36.595218ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
38842024-11-19T02:19:15.764ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38852024-11-19T02:19:15.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38862024-11-19T02:19:15.765ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38872024-11-19T02:19:15.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38882024-11-19T02:19:15.766ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38892024-11-19T02:19:15.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38902024-11-19T02:19:15.768ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38912024-11-19T02:19:15.772ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38922024-11-19T02:19:15.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: ffe74824-0c08-48e1-a755-fb123e8dc181, lookup_type: ById(ffe74824-0c08-48e1-a755-fb123e8dc181) } result = Ok(())
38932024-11-19T02:19:15.772ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38942024-11-19T02:19:15.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38952024-11-19T02:19:15.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
38962024-11-19T02:19:15.774ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38972024-11-19T02:19:15.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38982024-11-19T02:19:15.774ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
38992024-11-19T02:19:15.774ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
39002024-11-19T02:19:15.774ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 50.458408ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
39012024-11-19T02:19:15.774ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 50.626789ms iteration = 20 status = 0
39022024-11-19T02:19:15.797ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39032024-11-19T02:19:15.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39042024-11-19T02:19:15.812ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 88.072958ms iteration = 23 status = {"physical_disks_added":0}
39052024-11-19T02:19:15.814ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39062024-11-19T02:19:15.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39072024-11-19T02:19:15.816ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39082024-11-19T02:19:15.816ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
39092024-11-19T02:19:15.816ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
39102024-11-19T02:19:15.816ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3f76cf59-4b73-4014-88ca-218276c2795a", "content-length": "26", "date": "Tue, 19 Nov 2024 02:19:15 GMT"} })
39112024-11-19T02:19:15.816ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
39122024-11-19T02:19:15.818ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
39132024-11-19T02:19:15.818ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39142024-11-19T02:19:15.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39152024-11-19T02:19:15.819ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
39162024-11-19T02:19:15.833ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 109.772447ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
39172024-11-19T02:19:15.839ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
39182024-11-19T02:19:15.839ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
39192024-11-19T02:19:15.839ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1def7573-92bd-493a-ae4d-d03da50b7ff4", "content-length": "26", "date": "Tue, 19 Nov 2024 02:19:15 GMT"} })
39202024-11-19T02:19:15.839ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
39212024-11-19T02:19:15.841ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
39222024-11-19T02:19:15.851ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 zone_address = fd00:1122:3344:101::2
39232024-11-19T02:19:15.851ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
39242024-11-19T02:19:15.851ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf6d93b3-14a8-47a8-95b6-f86d8b78f6f3", "content-length": "26", "date": "Tue, 19 Nov 2024 02:19:15 GMT"} })
39252024-11-19T02:19:15.851ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
39262024-11-19T02:19:15.852ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
39272024-11-19T02:19:15.909ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e4271703-e51e-487d-adb4-48c84312dee9 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
39282024-11-19T02:19:15.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e4271703-e51e-487d-adb4-48c84312dee9 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
39292024-11-19T02:19:15.936ZINFOnexus (BackgroundTasks): VPC route manager sled ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
39302024-11-19T02:19:15.936ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
39312024-11-19T02:19:15.936ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "34ee7846-6813-4101-bf95-a2e46a579104", "content-length": "372", "date": "Tue, 19 Nov 2024 02:19:15 GMT"} })
39322024-11-19T02:19:15.936ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39332024-11-19T02:19:15.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39342024-11-19T02:19:15.937ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39352024-11-19T02:19:15.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30185 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e4271703-e51e-487d-adb4-48c84312dee9 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
39362024-11-19T02:19:15.940ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
39372024-11-19T02:19:15.940ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39382024-11-19T02:19:15.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39392024-11-19T02:19:15.952ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
39402024-11-19T02:19:15.952ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
39412024-11-19T02:19:15.952ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "fb78e6a2-e2ca-49ed-b677-d198771fef0b", "date": "Tue, 19 Nov 2024 02:19:15 GMT"} })
39422024-11-19T02:19:15.952ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39432024-11-19T02:19:15.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39442024-11-19T02:19:15.955ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39452024-11-19T02:19:15.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39462024-11-19T02:19:15.959ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39472024-11-19T02:19:15.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39482024-11-19T02:19:15.964ZINFOnexus (BackgroundTasks): VPC route manager sled ffe74824-0c08-48e1-a755-fb123e8dc181 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
39492024-11-19T02:19:15.964ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
39502024-11-19T02:19:15.965ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b0d2e6f0-a307-4005-abf4-6c729eca3688", "date": "Tue, 19 Nov 2024 02:19:15 GMT"} })
39512024-11-19T02:19:15.967ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 243.070032ms iteration = 21 status = {}
39522024-11-19T02:19:16.032ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 308.992697ms iteration = 20 status = {}
39532024-11-19T02:19:16.036ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
39542024-11-19T02:19:16.036ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d7183e8b-e400-4b62-8ddd-77b19082c892", "content-length": "1", "date": "Tue, 19 Nov 2024 02:19:15 GMT"} })
39552024-11-19T02:19:16.039ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
39562024-11-19T02:19:16.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
39572024-11-19T02:19:16.041ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 318.338334ms iteration = 20 status = null
39582024-11-19T02:19:16.092ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
39592024-11-19T02:19:16.093ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e987fc04-a42f-440b-b77e-d872b406f3a0", "content-length": "691", "date": "Tue, 19 Nov 2024 02:19:15 GMT"} })
39602024-11-19T02:19:16.093ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
39612024-11-19T02:19:16.093ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
39622024-11-19T02:19:16.093ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
39632024-11-19T02:19:16.099ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 375.526919ms iteration = 20 status = {}
39642024-11-19T02:19:16.114ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39652024-11-19T02:19:16.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39662024-11-19T02:19:16.117ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 20bc3881-e2ee-4d8d-b84b-b0c1e478721f, rack_id: a894e92e-d765-4f15-b6b7-cb9ca46d1860, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8597d802-6d4d-4493-88de-333a1f340c20) } rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0
39672024-11-19T02:19:16.117ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39682024-11-19T02:19:16.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39692024-11-19T02:19:16.128ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
39702024-11-19T02:19:16.129ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "bde8729d-2fdb-4807-bcf8-bab2195f8e2a", "content-length": "134", "date": "Tue, 19 Nov 2024 02:19:15 GMT"} })
39712024-11-19T02:19:16.129ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
39722024-11-19T02:19:16.129ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8597d802-6d4d-4493-88de-333a1f340c20
39732024-11-19T02:19:16.129ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
39742024-11-19T02:19:16.129ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
39752024-11-19T02:19:16.129ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
39762024-11-19T02:19:16.129ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
39772024-11-19T02:19:16.129ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
39782024-11-19T02:19:16.129ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
39792024-11-19T02:19:16.129ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
39802024-11-19T02:19:16.129ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
39812024-11-19T02:19:16.130ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
39822024-11-19T02:19:16.130ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39832024-11-19T02:19:16.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39842024-11-19T02:19:16.132ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
39852024-11-19T02:19:16.132ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "50813d27-0e1e-4bcc-9c49-09dbeb2c4de0", "content-length": "2", "date": "Tue, 19 Nov 2024 02:19:15 GMT"} })
39862024-11-19T02:19:16.132ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
39872024-11-19T02:19:16.132ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "0beaee53-57c8-4b19-8053-235da5a693b3", "content-length": "52", "date": "Tue, 19 Nov 2024 02:19:15 GMT"} })
39882024-11-19T02:19:16.132ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0
39892024-11-19T02:19:16.132ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
39902024-11-19T02:19:16.250ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "463110da-b0ed-434f-b67b-da800702002d", "date": "Tue, 19 Nov 2024 02:19:15 GMT"} })
39912024-11-19T02:19:16.251ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch = Switch0
39922024-11-19T02:19:16.251ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
39932024-11-19T02:19:16.251ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "89c17481-4277-4b70-a50b-c90d95143915", "content-length": "682", "date": "Tue, 19 Nov 2024 02:19:16 GMT"} })
39942024-11-19T02:19:16.251ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39952024-11-19T02:19:16.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39962024-11-19T02:19:16.255ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39972024-11-19T02:19:16.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39982024-11-19T02:19:16.259ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39992024-11-19T02:19:16.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40002024-11-19T02:19:16.261ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40012024-11-19T02:19:16.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40022024-11-19T02:19:16.269ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 545.637015ms iteration = 20 status = {}
40032024-11-19T02:19:16.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = ef32c118-f0d5-4edd-a0b2-d6ac21026bc1 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
40042024-11-19T02:19:16.940ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = ef32c118-f0d5-4edd-a0b2-d6ac21026bc1 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
40052024-11-19T02:19:16.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3352 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = ef32c118-f0d5-4edd-a0b2-d6ac21026bc1 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
40062024-11-19T02:19:16.965ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6f26219a-9ca2-4d2a-a7c2-a89ed3686723 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
40072024-11-19T02:19:16.966ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6f26219a-9ca2-4d2a-a7c2-a89ed3686723 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
40082024-11-19T02:19:16.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2150 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6f26219a-9ca2-4d2a-a7c2-a89ed3686723 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
40092024-11-19T02:19:17.988ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 8f0f5a2e-5cde-4c8a-a80f-71dcb5392095 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
40102024-11-19T02:19:17.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 8f0f5a2e-5cde-4c8a-a80f-71dcb5392095 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
40112024-11-19T02:19:17.990ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1757 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 8f0f5a2e-5cde-4c8a-a80f-71dcb5392095 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
40122024-11-19T02:19:19.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0e4f4ad7-8555-4ced-a514-08f14f0c725c roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
40132024-11-19T02:19:19.013ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0e4f4ad7-8555-4ced-a514-08f14f0c725c resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
40142024-11-19T02:19:19.015ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3016 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0e4f4ad7-8555-4ced-a514-08f14f0c725c response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
40152024-11-19T02:19:20.036ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d2421158-ec51-4250-95f8-d32cee39773b roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
40162024-11-19T02:19:20.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d2421158-ec51-4250-95f8-d32cee39773b resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
40172024-11-19T02:19:20.038ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2296 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d2421158-ec51-4250-95f8-d32cee39773b response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
40182024-11-19T02:19:21.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9968b9a0-56af-4f9f-899f-00d0ff3f24c5 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
40192024-11-19T02:19:21.062ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9968b9a0-56af-4f9f-899f-00d0ff3f24c5 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
40202024-11-19T02:19:21.065ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3388 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9968b9a0-56af-4f9f-899f-00d0ff3f24c5 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
40212024-11-19T02:19:22.086ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 68335431-4391-408c-b411-e4a2ad8db5c1 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
40222024-11-19T02:19:22.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 68335431-4391-408c-b411-e4a2ad8db5c1 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
40232024-11-19T02:19:22.089ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2260 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 68335431-4391-408c-b411-e4a2ad8db5c1 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
40242024-11-19T02:19:22.154ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1628 local_addr = [fd00:1122:3344:101::c]:60807 method = GET remote_addr = [fd00:1122:3344:101::d]:57844 req_id = 0b36a1f3-0d96-492d-a67f-a922600e070c response_code = 200 uri = /9f0b435f-0000-451e-9dbc-dcec71543c30
40252024-11-19T02:19:23.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c0d7b17a-a6b4-415d-8f0a-91fe1b840b1c roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
40262024-11-19T02:19:23.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c0d7b17a-a6b4-415d-8f0a-91fe1b840b1c resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
40272024-11-19T02:19:23.112ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2076 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c0d7b17a-a6b4-415d-8f0a-91fe1b840b1c response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
40282024-11-19T02:19:24.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = fdd9b368-8d37-45bf-ab1b-db97ed201f52 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
40292024-11-19T02:19:24.133ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = fdd9b368-8d37-45bf-ab1b-db97ed201f52 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
40302024-11-19T02:19:24.135ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2248 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = fdd9b368-8d37-45bf-ab1b-db97ed201f52 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
40312024-11-19T02:19:25.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 665f7081-9559-4ee8-b3e6-79773a08385c roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
40322024-11-19T02:19:25.156ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 665f7081-9559-4ee8-b3e6-79773a08385c resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
40332024-11-19T02:19:25.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2336 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 665f7081-9559-4ee8-b3e6-79773a08385c response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
40342024-11-19T02:19:25.724ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
40352024-11-19T02:19:25.724ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
40362024-11-19T02:19:25.724ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40372024-11-19T02:19:25.725ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40382024-11-19T02:19:25.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40392024-11-19T02:19:25.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40402024-11-19T02:19:25.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40412024-11-19T02:19:25.729ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40422024-11-19T02:19:25.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40432024-11-19T02:19:25.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40442024-11-19T02:19:25.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40452024-11-19T02:19:25.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40462024-11-19T02:19:25.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40472024-11-19T02:19:25.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
40482024-11-19T02:19:25.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40492024-11-19T02:19:25.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40502024-11-19T02:19:25.745ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
40512024-11-19T02:19:25.745ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.126311ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
40522024-11-19T02:19:25.754ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40532024-11-19T02:19:25.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40542024-11-19T02:19:25.755ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.034005ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
40552024-11-19T02:19:26.180ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 34918bb6-588f-4436-8a28-81ae1f96fa67 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
40562024-11-19T02:19:26.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 34918bb6-588f-4436-8a28-81ae1f96fa67 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
40572024-11-19T02:19:26.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2151 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 34918bb6-588f-4436-8a28-81ae1f96fa67 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
40582024-11-19T02:19:27.203ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4b4d9d9f-61c6-4a3c-a0b0-161281d1b7f9 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
40592024-11-19T02:19:27.203ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4b4d9d9f-61c6-4a3c-a0b0-161281d1b7f9 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
40602024-11-19T02:19:27.205ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2040 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4b4d9d9f-61c6-4a3c-a0b0-161281d1b7f9 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
40612024-11-19T02:19:28.226ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ba998630-3d7a-45ff-9eaa-25d6d5daec63 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
40622024-11-19T02:19:28.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ba998630-3d7a-45ff-9eaa-25d6d5daec63 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
40632024-11-19T02:19:28.228ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2030 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ba998630-3d7a-45ff-9eaa-25d6d5daec63 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
40642024-11-19T02:19:29.250ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 039d5e5a-694a-484c-9b28-297c96abb63c roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
40652024-11-19T02:19:29.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 039d5e5a-694a-484c-9b28-297c96abb63c resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
40662024-11-19T02:19:29.252ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2402 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 039d5e5a-694a-484c-9b28-297c96abb63c response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
40672024-11-19T02:19:30.273ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 2b956e65-4900-4c89-9137-dc17e39fad3e roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
40682024-11-19T02:19:30.274ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 2b956e65-4900-4c89-9137-dc17e39fad3e resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
40692024-11-19T02:19:30.275ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2326 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 2b956e65-4900-4c89-9137-dc17e39fad3e response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
40702024-11-19T02:19:31.297ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0ae90bf2-af9a-48e9-93a6-86918e805a4b roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
40712024-11-19T02:19:31.297ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0ae90bf2-af9a-48e9-93a6-86918e805a4b resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
40722024-11-19T02:19:31.299ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2208 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0ae90bf2-af9a-48e9-93a6-86918e805a4b response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
40732024-11-19T02:19:32.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e17797bf-736a-4f41-b870-e93e48050842 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
40742024-11-19T02:19:32.322ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e17797bf-736a-4f41-b870-e93e48050842 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
40752024-11-19T02:19:32.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2135 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e17797bf-736a-4f41-b870-e93e48050842 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
40762024-11-19T02:19:33.346ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = fc5cd1e0-5bcd-4d1e-8236-59f07d248f1d roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
40772024-11-19T02:19:33.346ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = fc5cd1e0-5bcd-4d1e-8236-59f07d248f1d resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
40782024-11-19T02:19:33.348ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2332 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = fc5cd1e0-5bcd-4d1e-8236-59f07d248f1d response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
40792024-11-19T02:19:34.371ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9dbbe6a0-7cc3-49d7-81e8-56d7cd858cff roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
40802024-11-19T02:19:34.371ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9dbbe6a0-7cc3-49d7-81e8-56d7cd858cff resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
40812024-11-19T02:19:34.373ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2227 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9dbbe6a0-7cc3-49d7-81e8-56d7cd858cff response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
40822024-11-19T02:19:35.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 024e5fa7-c594-4b4d-8969-dcb3a44240e4 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
40832024-11-19T02:19:35.395ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 024e5fa7-c594-4b4d-8969-dcb3a44240e4 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
40842024-11-19T02:19:35.397ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2311 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 024e5fa7-c594-4b4d-8969-dcb3a44240e4 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
40852024-11-19T02:19:35.725ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
40862024-11-19T02:19:35.725ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
40872024-11-19T02:19:35.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40882024-11-19T02:19:35.725ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40892024-11-19T02:19:35.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40902024-11-19T02:19:35.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40912024-11-19T02:19:35.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40922024-11-19T02:19:35.728ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40932024-11-19T02:19:35.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40942024-11-19T02:19:35.730ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40952024-11-19T02:19:35.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40962024-11-19T02:19:35.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40972024-11-19T02:19:35.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40982024-11-19T02:19:35.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40992024-11-19T02:19:35.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41002024-11-19T02:19:35.736ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
41012024-11-19T02:19:35.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41022024-11-19T02:19:35.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41032024-11-19T02:19:35.749ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
41042024-11-19T02:19:35.749ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.251187ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
41052024-11-19T02:19:35.759ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.815627ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
41062024-11-19T02:19:36.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 49015de7-e2bc-4c9c-bcf3-05aa1807ee78 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
41072024-11-19T02:19:36.419ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 49015de7-e2bc-4c9c-bcf3-05aa1807ee78 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
41082024-11-19T02:19:36.420ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1917 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 49015de7-e2bc-4c9c-bcf3-05aa1807ee78 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
41092024-11-19T02:19:37.153ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1274 local_addr = [fd00:1122:3344:101::c]:60807 method = GET remote_addr = [fd00:1122:3344:101::d]:57844 req_id = a2a49de2-a005-43a1-af0b-039adb31389e response_code = 200 uri = /9f0b435f-0000-451e-9dbc-dcec71543c30
41102024-11-19T02:19:37.442ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = fb1a3b0a-b75e-4fb3-8129-76242607be6d roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
41112024-11-19T02:19:37.442ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = fb1a3b0a-b75e-4fb3-8129-76242607be6d resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
41122024-11-19T02:19:37.444ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2028 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = fb1a3b0a-b75e-4fb3-8129-76242607be6d response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
41132024-11-19T02:19:38.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a01187ef-7973-451f-9363-51fb2b43431d roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
41142024-11-19T02:19:38.467ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a01187ef-7973-451f-9363-51fb2b43431d resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
41152024-11-19T02:19:38.468ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2075 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a01187ef-7973-451f-9363-51fb2b43431d response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
41162024-11-19T02:19:39.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e3b8a5fe-cca3-4143-b26b-cc75c84cd0e6 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
41172024-11-19T02:19:39.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e3b8a5fe-cca3-4143-b26b-cc75c84cd0e6 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
41182024-11-19T02:19:39.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2530 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e3b8a5fe-cca3-4143-b26b-cc75c84cd0e6 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
41192024-11-19T02:19:40.515ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0e216ee0-a748-4aa7-9efd-d285a839a033 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
41202024-11-19T02:19:40.516ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0e216ee0-a748-4aa7-9efd-d285a839a033 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
41212024-11-19T02:19:40.517ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2122 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0e216ee0-a748-4aa7-9efd-d285a839a033 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
41222024-11-19T02:19:41.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 588caac3-2823-478b-8567-efa8f5afdf87 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
41232024-11-19T02:19:41.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 588caac3-2823-478b-8567-efa8f5afdf87 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
41242024-11-19T02:19:41.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2147 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 588caac3-2823-478b-8567-efa8f5afdf87 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
41252024-11-19T02:19:42.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = 6da1eb8f-ec4e-418b-a30a-d8fd6ce16ec5 roles = RoleSet { roles: {} } uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?sort_by=id_ascending
41262024-11-19T02:19:42.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = 6da1eb8f-ec4e-418b-a30a-d8fd6ce16ec5 resource = Database result = Ok(()) uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?sort_by=id_ascending
41272024-11-19T02:19:42.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2773 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = 6da1eb8f-ec4e-418b-a30a-d8fd6ce16ec5 response_code = 200 uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?sort_by=id_ascending
41282024-11-19T02:19:42.147ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = 74ffa0a4-0c3a-4380-b26c-4e7e9a326cf9 roles = RoleSet { roles: {} } uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZmU3NDgyNC0wYzA4LTQ4ZTEtYTc1NS1mYjEyM2U4ZGMxODEifX0%3D
41292024-11-19T02:19:42.147ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = 74ffa0a4-0c3a-4380-b26c-4e7e9a326cf9 resource = Database result = Ok(()) uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZmU3NDgyNC0wYzA4LTQ4ZTEtYTc1NS1mYjEyM2U4ZGMxODEifX0%3D
41302024-11-19T02:19:42.149ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2499 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = 74ffa0a4-0c3a-4380-b26c-4e7e9a326cf9 response_code = 200 uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZmU3NDgyNC0wYzA4LTQ4ZTEtYTc1NS1mYjEyM2U4ZGMxODEifX0%3D
41312024-11-19T02:19:42.563ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 39e183e9-f8ab-4c11-b404-e2d586633f81 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
41322024-11-19T02:19:42.564ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 39e183e9-f8ab-4c11-b404-e2d586633f81 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
41332024-11-19T02:19:42.566ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2305 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 39e183e9-f8ab-4c11-b404-e2d586633f81 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
41342024-11-19T02:19:43.588ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 23736970-2d67-40a3-9c95-567139860315 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
41352024-11-19T02:19:43.588ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 23736970-2d67-40a3-9c95-567139860315 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
41362024-11-19T02:19:43.590ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2275 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 23736970-2d67-40a3-9c95-567139860315 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
41372024-11-19T02:19:44.369ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:57319
41382024-11-19T02:19:44.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:57319 req_id = 5f851560-618e-4cf1-8751-44d376f1bd94 roles = RoleSet { roles: {} } uri = /metrics/producers
41392024-11-19T02:19:44.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:57319 req_id = 5f851560-618e-4cf1-8751-44d376f1bd94 resource = Database result = Ok(()) uri = /metrics/producers
41402024-11-19T02:19:44.384ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:33143
41412024-11-19T02:19:44.384ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:33143 req_id = f4d664d8-1738-4dfa-bfb6-cc18c712b7ea roles = RoleSet { roles: {} } uri = /metrics/producers
41422024-11-19T02:19:44.384ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:33143 req_id = f4d664d8-1738-4dfa-bfb6-cc18c712b7ea resource = Database result = Ok(()) uri = /metrics/producers
41432024-11-19T02:19:44.407ZINFOnexus: assigned collector to new producer collector_id = 3980dd20-a3be-40d3-b9e5-094b8ed4b785 file = nexus/src/app/oximeter.rs:76 producer_id = 4531e85d-d56a-4e09-b4e5-16020bc21701
41442024-11-19T02:19:44.407ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38112 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:57319 req_id = 5f851560-618e-4cf1-8751-44d376f1bd94 response_code = 201 uri = /metrics/producers
41452024-11-19T02:19:44.417ZINFOnexus: assigned collector to new producer collector_id = 3980dd20-a3be-40d3-b9e5-094b8ed4b785 file = nexus/src/app/oximeter.rs:76 producer_id = ffe74824-0c08-48e1-a755-fb123e8dc181
41462024-11-19T02:19:44.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33068 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:33143 req_id = f4d664d8-1738-4dfa-bfb6-cc18c712b7ea response_code = 201 uri = /metrics/producers
41472024-11-19T02:19:44.612ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 8453590f-203d-42f4-912a-76d2bcf0583f roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
41482024-11-19T02:19:44.612ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 8453590f-203d-42f4-912a-76d2bcf0583f resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
41492024-11-19T02:19:44.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1908 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 8453590f-203d-42f4-912a-76d2bcf0583f response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
41502024-11-19T02:19:45.031ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:50151
41512024-11-19T02:19:45.031ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50151 req_id = c139e5b0-2f5f-4c9f-b72b-7850c6d66009 roles = RoleSet { roles: {} } uri = /metrics/producers
41522024-11-19T02:19:45.032ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50151 req_id = c139e5b0-2f5f-4c9f-b72b-7850c6d66009 resource = Database result = Ok(()) uri = /metrics/producers
41532024-11-19T02:19:45.074ZINFOnexus: assigned collector to new producer collector_id = 3980dd20-a3be-40d3-b9e5-094b8ed4b785 file = nexus/src/app/oximeter.rs:76 producer_id = cd87c155-df14-4737-bbdc-04963164d701
41542024-11-19T02:19:45.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42670 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50151 req_id = c139e5b0-2f5f-4c9f-b72b-7850c6d66009 response_code = 201 uri = /metrics/producers
41552024-11-19T02:19:45.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d29f2c2d-715b-47a7-899c-9367905ed76d roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
41562024-11-19T02:19:45.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d29f2c2d-715b-47a7-899c-9367905ed76d resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
41572024-11-19T02:19:45.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2299 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d29f2c2d-715b-47a7-899c-9367905ed76d response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
41582024-11-19T02:19:45.724ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
41592024-11-19T02:19:45.724ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
41602024-11-19T02:19:45.724ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
41612024-11-19T02:19:45.724ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41622024-11-19T02:19:45.724ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
41632024-11-19T02:19:45.724ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
41642024-11-19T02:19:45.724ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
41652024-11-19T02:19:45.724ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
41662024-11-19T02:19:45.724ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
41672024-11-19T02:19:45.724ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
41682024-11-19T02:19:45.724ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41692024-11-19T02:19:45.724ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
41702024-11-19T02:19:45.724ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
41712024-11-19T02:19:45.724ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
41722024-11-19T02:19:45.724ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41732024-11-19T02:19:45.724ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
41742024-11-19T02:19:45.724ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
41752024-11-19T02:19:45.724ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-19 02:09:45.724198953 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
41762024-11-19T02:19:45.724ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
41772024-11-19T02:19:45.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41782024-11-19T02:19:45.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
41792024-11-19T02:19:45.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
41802024-11-19T02:19:45.724ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
41812024-11-19T02:19:45.724ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
41822024-11-19T02:19:45.724ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
41832024-11-19T02:19:45.724ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
41842024-11-19T02:19:45.724ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
41852024-11-19T02:19:45.724ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41862024-11-19T02:19:45.724ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
41872024-11-19T02:19:45.724ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41882024-11-19T02:19:45.724ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
41892024-11-19T02:19:45.724ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
41902024-11-19T02:19:45.724ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
41912024-11-19T02:19:45.724ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
41922024-11-19T02:19:45.724ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 4 reason = Timeout
41932024-11-19T02:19:45.724ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
41942024-11-19T02:19:45.724ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41952024-11-19T02:19:45.724ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
41962024-11-19T02:19:45.724ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Timeout
41972024-11-19T02:19:45.724ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41982024-11-19T02:19:45.724ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
41992024-11-19T02:19:45.724ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
42002024-11-19T02:19:45.724ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
42012024-11-19T02:19:45.724ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
42022024-11-19T02:19:45.724ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
42032024-11-19T02:19:45.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
42042024-11-19T02:19:45.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42052024-11-19T02:19:45.724ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
42062024-11-19T02:19:45.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42072024-11-19T02:19:45.724ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
42082024-11-19T02:19:45.724ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
42092024-11-19T02:19:45.724ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
42102024-11-19T02:19:45.724ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
42112024-11-19T02:19:45.724ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
42122024-11-19T02:19:45.724ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
42132024-11-19T02:19:45.724ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
42142024-11-19T02:19:45.724ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115
42152024-11-19T02:19:45.724ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42162024-11-19T02:19:45.724ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
42172024-11-19T02:19:45.724ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 9.011\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115"}
42182024-11-19T02:19:45.724ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
42192024-11-19T02:19:45.724ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
42202024-11-19T02:19:45.724ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
42212024-11-19T02:19:45.724ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
42222024-11-19T02:19:45.725ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42232024-11-19T02:19:45.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42242024-11-19T02:19:45.725ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
42252024-11-19T02:19:45.725ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42262024-11-19T02:19:45.725ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
42272024-11-19T02:19:45.725ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
42282024-11-19T02:19:45.725ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
42292024-11-19T02:19:45.725ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
42302024-11-19T02:19:45.725ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
42312024-11-19T02:19:45.725ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
42322024-11-19T02:19:45.725ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
42332024-11-19T02:19:45.725ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
42342024-11-19T02:19:45.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42352024-11-19T02:19:45.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
42362024-11-19T02:19:45.725ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("27d1a6ca-1b76-4956-aefa-e234c7d60cd0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("91bdcbd0-987b-49c4-8200-fc3e8f332b6b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("91bdcbd0-987b-49c4-8200-fc3e8f332b6b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1483, tv_nsec: 510141210 } })
42372024-11-19T02:19:45.725ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2d59cdb7-e3b1-4e94-afa3-f64f69928234.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a949a8d8-46c7-4423-b760-c03f98ccf638.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b190a9bf-d8b7-43c3-add4-e113c9b89870.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b190a9bf-d8b7-43c3-add4-e113c9b89870.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1483, tv_nsec: 510147230 } })
42382024-11-19T02:19:45.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
42392024-11-19T02:19:45.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
42402024-11-19T02:19:45.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42412024-11-19T02:19:45.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42422024-11-19T02:19:45.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42432024-11-19T02:19:45.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42442024-11-19T02:19:45.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
42452024-11-19T02:19:45.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
42462024-11-19T02:19:45.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42472024-11-19T02:19:45.725ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
42482024-11-19T02:19:45.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
42492024-11-19T02:19:45.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42502024-11-19T02:19:45.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
42512024-11-19T02:19:45.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
42522024-11-19T02:19:45.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
42532024-11-19T02:19:45.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42542024-11-19T02:19:45.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
42552024-11-19T02:19:45.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
42562024-11-19T02:19:45.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
42572024-11-19T02:19:45.725ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
42582024-11-19T02:19:45.725ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.325735ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
42592024-11-19T02:19:45.725ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
42602024-11-19T02:19:45.725ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.527938ms iteration = 12 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
42612024-11-19T02:19:45.726ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42622024-11-19T02:19:45.727ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42632024-11-19T02:19:45.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42642024-11-19T02:19:45.727ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1483, tv_nsec: 512453737 } })
42652024-11-19T02:19:45.727ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
42662024-11-19T02:19:45.727ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1483, tv_nsec: 513038143 } })
42672024-11-19T02:19:45.728ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
42682024-11-19T02:19:45.728ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
42692024-11-19T02:19:45.728ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42702024-11-19T02:19:45.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
42712024-11-19T02:19:45.729ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42722024-11-19T02:19:45.729ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.039408ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
42732024-11-19T02:19:45.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42742024-11-19T02:19:45.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42752024-11-19T02:19:45.730ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-19 02:09:45.724198953 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
42762024-11-19T02:19:45.730ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 6.797167ms iteration = 11 status = {"expiration":"2024-11-19T02:09:45.724198953Z","pruned":[]}
42772024-11-19T02:19:45.731ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42782024-11-19T02:19:45.732ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42792024-11-19T02:19:45.732ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42802024-11-19T02:19:45.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
42812024-11-19T02:19:45.734ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
42822024-11-19T02:19:45.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
42832024-11-19T02:19:45.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42842024-11-19T02:19:45.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42852024-11-19T02:19:45.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42862024-11-19T02:19:45.735ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
42872024-11-19T02:19:45.735ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
42882024-11-19T02:19:45.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
42892024-11-19T02:19:45.735ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
42902024-11-19T02:19:45.735ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42912024-11-19T02:19:45.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42922024-11-19T02:19:45.736ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42932024-11-19T02:19:45.737ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42942024-11-19T02:19:45.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42952024-11-19T02:19:45.737ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42962024-11-19T02:19:45.738ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42972024-11-19T02:19:45.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
42982024-11-19T02:19:45.740ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42992024-11-19T02:19:45.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43002024-11-19T02:19:45.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
43012024-11-19T02:19:45.740ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43022024-11-19T02:19:45.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43032024-11-19T02:19:45.740ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
43042024-11-19T02:19:45.741ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
43052024-11-19T02:19:45.741ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43062024-11-19T02:19:45.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
43072024-11-19T02:19:45.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43082024-11-19T02:19:45.742ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43092024-11-19T02:19:45.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43102024-11-19T02:19:45.746ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 21.684338ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
43112024-11-19T02:19:45.748ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43122024-11-19T02:19:45.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43132024-11-19T02:19:45.748ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43142024-11-19T02:19:45.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43152024-11-19T02:19:45.750ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43162024-11-19T02:19:45.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43172024-11-19T02:19:45.750ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43182024-11-19T02:19:45.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43192024-11-19T02:19:45.753ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1483, tv_nsec: 538410604 } })
43202024-11-19T02:19:45.753ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
43212024-11-19T02:19:45.767ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43222024-11-19T02:19:45.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43232024-11-19T02:19:45.775ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43242024-11-19T02:19:45.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43252024-11-19T02:19:45.777ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(b57f626a-c88a-4603-8a0c-10a36ee7009d, 0), (bf8c88e7-6fe6-43c0-8bf8-89628acecaba, 0), (e676e34b-5987-4656-bfd0-c9931f91ad5a, 0), (b8ef2bd2-a7b3-4518-bdba-056c305f62a3, 0)] collection_id = b57f626a-c88a-4603-8a0c-10a36ee7009d
43262024-11-19T02:19:45.777ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
43272024-11-19T02:19:45.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
43282024-11-19T02:19:45.782ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
43292024-11-19T02:19:45.782ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
43302024-11-19T02:19:45.782ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 57.908193ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
43312024-11-19T02:19:45.784ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43322024-11-19T02:19:45.789ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
43332024-11-19T02:19:45.789ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43342024-11-19T02:19:45.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43352024-11-19T02:19:45.791ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43362024-11-19T02:19:45.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43372024-11-19T02:19:45.792ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
43382024-11-19T02:19:45.792ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
43392024-11-19T02:19:45.792ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43402024-11-19T02:19:45.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43412024-11-19T02:19:45.794ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43422024-11-19T02:19:45.795ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 70.290035ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
43432024-11-19T02:19:45.795ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
43442024-11-19T02:19:45.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
43452024-11-19T02:19:45.796ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
43462024-11-19T02:19:45.796ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
43472024-11-19T02:19:45.796ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 71.6069ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
43482024-11-19T02:19:45.796ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43492024-11-19T02:19:45.797ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43502024-11-19T02:19:45.797ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
43512024-11-19T02:19:45.797ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = ab847807-f36c-4016-bd00-2a6556b850aa
43522024-11-19T02:19:45.797ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 30498cc5-8f3c-4399-8fc9-8a0fd99ae012
43532024-11-19T02:19:45.798ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
43542024-11-19T02:19:45.798ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
43552024-11-19T02:19:45.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
43562024-11-19T02:19:45.799ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
43572024-11-19T02:19:45.799ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43582024-11-19T02:19:45.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43592024-11-19T02:19:45.799ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
43602024-11-19T02:19:45.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
43612024-11-19T02:19:45.801ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 7b2417f2-42ee-47ad-b556-4eab99744d34
43622024-11-19T02:19:45.801ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 30498cc5-8f3c-4399-8fc9-8a0fd99ae012
43632024-11-19T02:19:45.801ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 7b2417f2-42ee-47ad-b556-4eab99744d34
43642024-11-19T02:19:45.801ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = ab847807-f36c-4016-bd00-2a6556b850aa
43652024-11-19T02:19:45.801ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 76.349494ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":3,"recent_failures":[],"recent_recoveries":[]}
43662024-11-19T02:19:45.801ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 77.008852ms iteration = 21 status = {"errors":[],"records_set_to_done":[]}
43672024-11-19T02:19:45.801ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43682024-11-19T02:19:45.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43692024-11-19T02:19:45.802ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
43702024-11-19T02:19:45.803ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43712024-11-19T02:19:45.803ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43722024-11-19T02:19:45.805ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
43732024-11-19T02:19:45.805ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43742024-11-19T02:19:45.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43752024-11-19T02:19:45.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
43762024-11-19T02:19:45.809ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43772024-11-19T02:19:45.809ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
43782024-11-19T02:19:45.809ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
43792024-11-19T02:19:45.809ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
43802024-11-19T02:19:45.809ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43812024-11-19T02:19:45.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43822024-11-19T02:19:45.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43832024-11-19T02:19:45.809ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
43842024-11-19T02:19:45.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
43852024-11-19T02:19:45.812ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43862024-11-19T02:19:45.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43872024-11-19T02:19:45.813ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 88.412852ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
43882024-11-19T02:19:45.813ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43892024-11-19T02:19:45.814ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 90.163562ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
43902024-11-19T02:19:45.816ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43912024-11-19T02:19:45.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43922024-11-19T02:19:45.818ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
43932024-11-19T02:19:45.818ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43942024-11-19T02:19:45.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43952024-11-19T02:19:45.819ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
43962024-11-19T02:19:45.819ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 94.550792ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
43972024-11-19T02:19:45.820ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43982024-11-19T02:19:45.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43992024-11-19T02:19:45.822ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
44002024-11-19T02:19:45.822ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44012024-11-19T02:19:45.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
44022024-11-19T02:19:45.822ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44032024-11-19T02:19:45.826ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
44042024-11-19T02:19:45.826ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44052024-11-19T02:19:45.826ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: ffe74824-0c08-48e1-a755-fb123e8dc181, lookup_type: ById(ffe74824-0c08-48e1-a755-fb123e8dc181) } result = Ok(())
44062024-11-19T02:19:45.826ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44072024-11-19T02:19:45.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44082024-11-19T02:19:45.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44092024-11-19T02:19:45.828ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 104.222113ms iteration = 21 status = 0
44102024-11-19T02:19:45.842ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
44112024-11-19T02:19:45.842ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
44122024-11-19T02:19:45.842ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
44132024-11-19T02:19:45.842ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44142024-11-19T02:19:45.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44152024-11-19T02:19:45.843ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = b57f626a-c88a-4603-8a0c-10a36ee7009d file = nexus/db-queries/src/db/datastore/inventory.rs:1446 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 0 nerrors = 0 nnics = 0 nnvme_disk_firmware = 0 nphysical_disks = 0 nrot_pages = 8 nrots = 2 nsled_agent_zones = 0 nsled_agents = 0 nsps = 2 nzones = 0 nzpools = 0
44162024-11-19T02:19:45.843ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
44172024-11-19T02:19:45.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
44182024-11-19T02:19:45.845ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44192024-11-19T02:19:45.845ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44202024-11-19T02:19:45.845ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
44212024-11-19T02:19:45.845ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44222024-11-19T02:19:45.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44232024-11-19T02:19:45.847ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44242024-11-19T02:19:45.849ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
44252024-11-19T02:19:45.849ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44262024-11-19T02:19:45.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44272024-11-19T02:19:45.851ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(bf8c88e7-6fe6-43c0-8bf8-89628acecaba, 0), (e676e34b-5987-4656-bfd0-c9931f91ad5a, 0), (b8ef2bd2-a7b3-4518-bdba-056c305f62a3, 0)]
44282024-11-19T02:19:45.851ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
44292024-11-19T02:19:45.851ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44302024-11-19T02:19:45.851ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44312024-11-19T02:19:45.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44322024-11-19T02:19:45.851ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1483, tv_nsec: 636815860 } })
44332024-11-19T02:19:45.853ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
44342024-11-19T02:19:45.853ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 8c04fa4d-031f-4603-9b0e-246b45d39276 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
44352024-11-19T02:19:45.853ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44362024-11-19T02:19:45.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44372024-11-19T02:19:45.853ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
44382024-11-19T02:19:45.853ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44392024-11-19T02:19:45.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44402024-11-19T02:19:45.855ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44412024-11-19T02:19:45.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44422024-11-19T02:19:45.855ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44432024-11-19T02:19:45.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
44442024-11-19T02:19:45.858ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44452024-11-19T02:19:45.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44462024-11-19T02:19:45.862ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 137.251791ms iteration = 21 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
44472024-11-19T02:19:45.864ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 8c04fa4d-031f-4603-9b0e-246b45d39276 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
44482024-11-19T02:19:45.864ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
44492024-11-19T02:19:45.864ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-19 02:10:27.714570 UTC dns_group = internal generation = 1
44502024-11-19T02:19:45.864ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 140.182375ms iteration = 12 status = {"generation":1}
44512024-11-19T02:19:45.865ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
44522024-11-19T02:19:45.865ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 140.942234ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
44532024-11-19T02:19:45.865ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 141.023174ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
44542024-11-19T02:19:45.876ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44552024-11-19T02:19:45.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44562024-11-19T02:19:45.878ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44572024-11-19T02:19:45.879ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
44582024-11-19T02:19:45.880ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
44592024-11-19T02:19:45.880ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44602024-11-19T02:19:45.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44612024-11-19T02:19:45.883ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44622024-11-19T02:19:45.886ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
44632024-11-19T02:19:45.886ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44642024-11-19T02:19:45.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44652024-11-19T02:19:45.887ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
44662024-11-19T02:19:45.888ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
44672024-11-19T02:19:45.888ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = af79c7eb-bc4d-42f8-9217-8b35affeeebb dns_zone_name = oxide.test found_so_far = 0 version = 2
44682024-11-19T02:19:45.888ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44692024-11-19T02:19:45.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44702024-11-19T02:19:45.893ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44712024-11-19T02:19:45.893ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
44722024-11-19T02:19:45.893ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 168.568449ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
44732024-11-19T02:19:45.909ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44742024-11-19T02:19:45.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44752024-11-19T02:19:45.916ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
44762024-11-19T02:19:45.916ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 191.954827ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
44772024-11-19T02:19:45.937ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-19T02:09:41.910054Z, time_modified: 2024-11-19T02:09:41.910054Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 78638afa-e975-44a9-b764-0afec18d156f, db_silo: Silo { identity: SiloIdentity { id: 78638afa-e975-44a9-b764-0afec18d156f, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-19T02:10:28.623188Z, time_modified: 2024-11-19T02:10:28.623188Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "fe94815f3f5502a309deafc95cd58d4fe61e984b7bd8ad11309589068beb64f5" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 78638afa-e975-44a9-b764-0afec18d156f, db_silo: Silo { identity: SiloIdentity { id: 78638afa-e975-44a9-b764-0afec18d156f, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-19T02:10:28.623188Z, time_modified: 2024-11-19T02:10:28.623188Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "fe94815f3f5502a309deafc95cd58d4fe61e984b7bd8ad11309589068beb64f5" }] }) }
44782024-11-19T02:19:45.937ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 212.997758ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"78638afa-e975-44a9-b764-0afec18d156f","tls_certs":["fe94815f3f5502a309deafc95cd58d4fe61e984b7bd8ad11309589068beb64f5"]}},"default_endpoint":{"silo_id":"78638afa-e975-44a9-b764-0afec18d156f","tls_certs":["fe94815f3f5502a309deafc95cd58d4fe61e984b7bd8ad11309589068beb64f5"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
44792024-11-19T02:19:45.967ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 242.638927ms iteration = 24 status = {"physical_disks_added":0}
44802024-11-19T02:19:46.048ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
44812024-11-19T02:19:46.048ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44822024-11-19T02:19:46.048ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "83ae7f8d-f080-4112-bd7d-0da6199d92a3", "content-length": "26", "date": "Tue, 19 Nov 2024 02:19:46 GMT"} })
44832024-11-19T02:19:46.048ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44842024-11-19T02:19:46.050ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
44852024-11-19T02:19:46.053ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 zone_address = fd00:1122:3344:101::2
44862024-11-19T02:19:46.053ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44872024-11-19T02:19:46.053ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0d0dd11a-6e1e-4100-9493-2f5d7b5e7260", "content-length": "26", "date": "Tue, 19 Nov 2024 02:19:46 GMT"} })
44882024-11-19T02:19:46.053ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44892024-11-19T02:19:46.058ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
44902024-11-19T02:19:46.095ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
44912024-11-19T02:19:46.095ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44922024-11-19T02:19:46.095ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2b7bcec7-43b4-4e6e-9e34-8b5924917c5b", "content-length": "26", "date": "Tue, 19 Nov 2024 02:19:46 GMT"} })
44932024-11-19T02:19:46.095ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44942024-11-19T02:19:46.097ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
44952024-11-19T02:19:46.118ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
44962024-11-19T02:19:46.118ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
44972024-11-19T02:19:46.118ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
44982024-11-19T02:19:46.119ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "f76f9350-cc8e-4c41-86f2-e126479e611f", "content-length": "476", "date": "Tue, 19 Nov 2024 02:19:46 GMT"} })
44992024-11-19T02:19:46.119ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
45002024-11-19T02:19:46.119ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5c30c741-312f-4552-9052-78dd85ff541f", "content-length": "734", "date": "Tue, 19 Nov 2024 02:19:46 GMT"} })
45012024-11-19T02:19:46.119ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
45022024-11-19T02:19:46.120ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac7edd8a-604b-48b9-9091-19189ba6c53e", "content-length": "111", "date": "Tue, 19 Nov 2024 02:19:46 GMT"} })
45032024-11-19T02:19:46.120ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
45042024-11-19T02:19:46.120ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "e24696a6-db67-479e-bf04-cc666eda9798", "content-length": "111", "date": "Tue, 19 Nov 2024 02:19:46 GMT"} })
45052024-11-19T02:19:46.120ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
45062024-11-19T02:19:46.120ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ed531f1-00b7-4826-86dd-9d10cf5d766c", "content-length": "167", "date": "Tue, 19 Nov 2024 02:19:46 GMT"} })
45072024-11-19T02:19:46.120ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
45082024-11-19T02:19:46.121ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ab46bf50-8e89-4846-9d59-5c320c5a538a", "content-length": "167", "date": "Tue, 19 Nov 2024 02:19:46 GMT"} })
45092024-11-19T02:19:46.121ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
45102024-11-19T02:19:46.121ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8ab76591-7bbc-42c7-ac97-5388966c1f96", "content-length": "175", "date": "Tue, 19 Nov 2024 02:19:46 GMT"} })
45112024-11-19T02:19:46.121ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
45122024-11-19T02:19:46.121ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a22158a0-bf0c-4b06-8816-4985c838243f", "content-length": "175", "date": "Tue, 19 Nov 2024 02:19:46 GMT"} })
45132024-11-19T02:19:46.121ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
45142024-11-19T02:19:46.121ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "20ca477c-58f1-4890-ad43-164db6886521", "content-length": "702", "date": "Tue, 19 Nov 2024 02:19:46 GMT"} })
45152024-11-19T02:19:46.121ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
45162024-11-19T02:19:46.122ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c12d5efe-b086-40cc-9049-ad71107f9267", "content-length": "727", "date": "Tue, 19 Nov 2024 02:19:46 GMT"} })
45172024-11-19T02:19:46.122ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
45182024-11-19T02:19:46.122ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "65ff7f47-71b4-476a-b8b1-e96c42002a58", "content-length": "729", "date": "Tue, 19 Nov 2024 02:19:46 GMT"} })
45192024-11-19T02:19:46.122ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
45202024-11-19T02:19:46.122ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f0c1bc6e-4294-42e6-b7d5-619db145b583", "content-length": "728", "date": "Tue, 19 Nov 2024 02:19:46 GMT"} })
45212024-11-19T02:19:46.122ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
45222024-11-19T02:19:46.122ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a8c96d96-e4d5-4eb1-9625-6701485213d5", "content-length": "722", "date": "Tue, 19 Nov 2024 02:19:46 GMT"} })
45232024-11-19T02:19:46.122ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
45242024-11-19T02:19:46.123ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "08066a69-2917-4170-b121-aeb6e3c67500", "content-length": "109", "date": "Tue, 19 Nov 2024 02:19:46 GMT"} })
45252024-11-19T02:19:46.123ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
45262024-11-19T02:19:46.123ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "628bdc67-6553-4f55-bad5-851a3de2f246", "content-length": "109", "date": "Tue, 19 Nov 2024 02:19:46 GMT"} })
45272024-11-19T02:19:46.123ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
45282024-11-19T02:19:46.123ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c7c4225-fd00-4fdc-8448-e6d5e552e1c3", "content-length": "169", "date": "Tue, 19 Nov 2024 02:19:46 GMT"} })
45292024-11-19T02:19:46.123ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
45302024-11-19T02:19:46.124ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "9d73b56a-cddd-4d01-9382-10a9a9b64434", "content-length": "169", "date": "Tue, 19 Nov 2024 02:19:46 GMT"} })
45312024-11-19T02:19:46.124ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
45322024-11-19T02:19:46.124ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f934cb1e-a6b2-41c4-82e5-aecf9b4d745b", "content-length": "178", "date": "Tue, 19 Nov 2024 02:19:46 GMT"} })
45332024-11-19T02:19:46.124ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
45342024-11-19T02:19:46.125ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "12e15448-4b78-46ff-954b-0e5cc4b598c5", "content-length": "178", "date": "Tue, 19 Nov 2024 02:19:46 GMT"} })
45352024-11-19T02:19:46.125ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
45362024-11-19T02:19:46.125ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a448c5ac-e7dc-484a-a093-4eb21c705338", "content-length": "702", "date": "Tue, 19 Nov 2024 02:19:46 GMT"} })
45372024-11-19T02:19:46.125ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
45382024-11-19T02:19:46.125ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f043f51d-3b0f-4bfd-a77c-13ba7e39bceb", "content-length": "727", "date": "Tue, 19 Nov 2024 02:19:46 GMT"} })
45392024-11-19T02:19:46.125ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
45402024-11-19T02:19:46.125ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a8b7a21-d599-4def-8a02-45777cee4996", "content-length": "729", "date": "Tue, 19 Nov 2024 02:19:46 GMT"} })
45412024-11-19T02:19:46.125ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
45422024-11-19T02:19:46.125ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "03853e44-2435-4dcd-bbcb-612b90d878d8", "content-length": "728", "date": "Tue, 19 Nov 2024 02:19:46 GMT"} })
45432024-11-19T02:19:46.125ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
45442024-11-19T02:19:46.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
45452024-11-19T02:19:46.141ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
45462024-11-19T02:19:46.142ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "fde2e76a-fb3c-4ed4-8b06-5c4dac79375c", "content-length": "691", "date": "Tue, 19 Nov 2024 02:19:46 GMT"} })
45472024-11-19T02:19:46.142ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
45482024-11-19T02:19:46.142ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
45492024-11-19T02:19:46.142ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
45502024-11-19T02:19:46.144ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 419.34269ms iteration = 21 status = {}
45512024-11-19T02:19:46.152ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
45522024-11-19T02:19:46.183ZINFOnexus (BackgroundTasks): VPC route manager sled ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
45532024-11-19T02:19:46.183ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
45542024-11-19T02:19:46.183ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "80596b52-6034-4d2c-a5c2-ebd65cfa6612", "content-length": "372", "date": "Tue, 19 Nov 2024 02:19:46 GMT"} })
45552024-11-19T02:19:46.183ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45562024-11-19T02:19:46.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45572024-11-19T02:19:46.186ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45582024-11-19T02:19:46.186ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45592024-11-19T02:19:46.186ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45602024-11-19T02:19:46.189ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
45612024-11-19T02:19:46.189ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
45622024-11-19T02:19:46.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
45632024-11-19T02:19:46.189ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
45642024-11-19T02:19:46.189ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45652024-11-19T02:19:46.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
45662024-11-19T02:19:46.190ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
45672024-11-19T02:19:46.190ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "2a016b9c-0834-4217-9121-19952e65b555", "date": "Tue, 19 Nov 2024 02:19:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
45682024-11-19T02:19:46.190ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
45692024-11-19T02:19:46.192ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45702024-11-19T02:19:46.192ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
45712024-11-19T02:19:46.192ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
45722024-11-19T02:19:46.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
45732024-11-19T02:19:46.192ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "cae5548a-395a-4f6e-b7d4-b3de390832cb", "date": "Tue, 19 Nov 2024 02:19:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
45742024-11-19T02:19:46.192ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
45752024-11-19T02:19:46.194ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = af79c7eb-bc4d-42f8-9217-8b35affeeebb dns_zone_name = oxide.test found_so_far = 1 version = 2
45762024-11-19T02:19:46.194ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
45772024-11-19T02:19:46.194ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-19 02:10:28.769117 UTC dns_group = external generation = 2
45782024-11-19T02:19:46.194ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 470.244652ms iteration = 12 status = {"generation":2}
45792024-11-19T02:19:46.194ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
45802024-11-19T02:19:46.194ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 470.570826ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
45812024-11-19T02:19:46.195ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
45822024-11-19T02:19:46.195ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
45832024-11-19T02:19:46.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
45842024-11-19T02:19:46.195ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
45852024-11-19T02:19:46.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
45862024-11-19T02:19:46.197ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
45872024-11-19T02:19:46.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
45882024-11-19T02:19:46.200ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
45892024-11-19T02:19:46.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
45902024-11-19T02:19:46.202ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
45912024-11-19T02:19:46.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
45922024-11-19T02:19:46.204ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
45932024-11-19T02:19:46.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
45942024-11-19T02:19:46.206ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
45952024-11-19T02:19:46.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
45962024-11-19T02:19:46.207ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45972024-11-19T02:19:46.211ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
45982024-11-19T02:19:46.211ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
45992024-11-19T02:19:46.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46002024-11-19T02:19:46.213ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46012024-11-19T02:19:46.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46022024-11-19T02:19:46.214ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46032024-11-19T02:19:46.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46042024-11-19T02:19:46.217ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46052024-11-19T02:19:46.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46062024-11-19T02:19:46.227ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46072024-11-19T02:19:46.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46082024-11-19T02:19:46.230ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46092024-11-19T02:19:46.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46102024-11-19T02:19:46.232ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46112024-11-19T02:19:46.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46122024-11-19T02:19:46.234ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46132024-11-19T02:19:46.234ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 510.658475ms iteration = 21 status = {}
46142024-11-19T02:19:46.241ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
46152024-11-19T02:19:46.241ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46162024-11-19T02:19:46.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46172024-11-19T02:19:46.242ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46182024-11-19T02:19:46.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46192024-11-19T02:19:46.244ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46202024-11-19T02:19:46.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46212024-11-19T02:19:46.246ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
46222024-11-19T02:19:46.247ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46232024-11-19T02:19:46.247ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d7de747f-3d96-4f83-8358-2ff36b086923", "content-length": "1", "date": "Tue, 19 Nov 2024 02:19:45 GMT"} })
46242024-11-19T02:19:46.249ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
46252024-11-19T02:19:46.249ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
46262024-11-19T02:19:46.249ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
46272024-11-19T02:19:46.249ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "835db785-3ab2-4143-928a-99a00ed57dcb", "date": "Tue, 19 Nov 2024 02:19:46 GMT"} })
46282024-11-19T02:19:46.249ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46292024-11-19T02:19:46.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
46302024-11-19T02:19:46.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46312024-11-19T02:19:46.251ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
46322024-11-19T02:19:46.251ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46332024-11-19T02:19:46.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46342024-11-19T02:19:46.251ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 527.918392ms iteration = 21 status = null
46352024-11-19T02:19:46.253ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46362024-11-19T02:19:46.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46372024-11-19T02:19:46.254ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
46382024-11-19T02:19:46.255ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "f5e7cd78-52b3-4f3d-a138-df6cf12fcf9c", "date": "Tue, 19 Nov 2024 02:19:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
46392024-11-19T02:19:46.255ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
46402024-11-19T02:19:46.257ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46412024-11-19T02:19:46.257ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46422024-11-19T02:19:46.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46432024-11-19T02:19:46.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46442024-11-19T02:19:46.257ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "e3967bf3-8d45-4ee7-a0b1-aadc84e45363", "date": "Tue, 19 Nov 2024 02:19:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
46452024-11-19T02:19:46.257ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
46462024-11-19T02:19:46.259ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46472024-11-19T02:19:46.260ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "d1793c61-9724-4d66-9b14-6d00c0e7f3b0", "date": "Tue, 19 Nov 2024 02:19:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
46482024-11-19T02:19:46.260ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
46492024-11-19T02:19:46.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46502024-11-19T02:19:46.260ZINFOnexus (BackgroundTasks): VPC route manager sled ffe74824-0c08-48e1-a755-fb123e8dc181 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
46512024-11-19T02:19:46.261ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
46522024-11-19T02:19:46.261ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "f3c4f74e-97ca-4984-9fd2-ca3af06d9097", "date": "Tue, 19 Nov 2024 02:19:46 GMT"} })
46532024-11-19T02:19:46.262ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46542024-11-19T02:19:46.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46552024-11-19T02:19:46.262ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
46562024-11-19T02:19:46.262ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 538.562165ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
46572024-11-19T02:19:46.263ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 538.514444ms iteration = 22 status = {}
46582024-11-19T02:19:46.264ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46592024-11-19T02:19:46.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46602024-11-19T02:19:46.266ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46612024-11-19T02:19:46.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46622024-11-19T02:19:46.268ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46632024-11-19T02:19:46.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46642024-11-19T02:19:46.270ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46652024-11-19T02:19:46.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46662024-11-19T02:19:46.272ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46672024-11-19T02:19:46.281ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
46682024-11-19T02:19:46.281ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46692024-11-19T02:19:46.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46702024-11-19T02:19:46.282ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46712024-11-19T02:19:46.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46722024-11-19T02:19:46.319ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
46732024-11-19T02:19:46.319ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
46742024-11-19T02:19:46.320ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46752024-11-19T02:19:46.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46762024-11-19T02:19:46.322ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46772024-11-19T02:19:46.323ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46782024-11-19T02:19:46.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46792024-11-19T02:19:46.328ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 20bc3881-e2ee-4d8d-b84b-b0c1e478721f, rack_id: a894e92e-d765-4f15-b6b7-cb9ca46d1860, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8597d802-6d4d-4493-88de-333a1f340c20) } rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0
46802024-11-19T02:19:46.328ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46812024-11-19T02:19:46.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46822024-11-19T02:19:46.330ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
46832024-11-19T02:19:46.330ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46842024-11-19T02:19:46.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46852024-11-19T02:19:46.332ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:48056
46862024-11-19T02:19:46.332ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48056 req_id = 0a27ff0a-c12e-45b9-b577-db7385539a36 roles = RoleSet { roles: {} } uri = /metrics/producers
46872024-11-19T02:19:46.332ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48056 req_id = 0a27ff0a-c12e-45b9-b577-db7385539a36 resource = Database result = Ok(()) uri = /metrics/producers
46882024-11-19T02:19:46.337ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 29b1632f-5910-4287-a228-0a2f072906c2, kind: Service { id: f02be878-8b16-4056-a261-089d083d36be }, name: Name("nexus-f02be878-8b16-4056-a261-089d083d36be"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 62])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ace3f45b-d569-4037-91af-4f9560e3857e, kind: Service { id: 9f0b435f-0000-451e-9dbc-dcec71543c30 }, name: Name("nexus-9f0b435f-0000-451e-9dbc-dcec71543c30"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 230])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f794593b-f8ae-411e-9836-93b29d4ba7a6, kind: Service { id: d90c9eb7-7c7e-4675-94ca-7779e9afc6c6 }, name: Name("nexus-d90c9eb7-7c7e-4675-94ca-7779e9afc6c6"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 194])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 1a01f5db-28b0-4d53-93f3-b21792e75a0f, kind: Service { id: 91bdcbd0-987b-49c4-8200-fc3e8f332b6b }, name: Name("external-dns-91bdcbd0-987b-49c4-8200-fc3e8f332b6b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 175])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 44aaf11d-41cc-4bfe-af84-bade0c866c36, kind: Service { id: 27d1a6ca-1b76-4956-aefa-e234c7d60cd0 }, name: Name("external-dns-27d1a6ca-1b76-4956-aefa-e234c7d60cd0"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
46892024-11-19T02:19:46.337ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46902024-11-19T02:19:46.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46912024-11-19T02:19:46.339ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46922024-11-19T02:19:46.340ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
46932024-11-19T02:19:46.340ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a5a1dbd-3b05-458a-b560-b5d1945ac490", "content-length": "134", "date": "Tue, 19 Nov 2024 02:19:45 GMT"} })
46942024-11-19T02:19:46.340ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
46952024-11-19T02:19:46.340ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8597d802-6d4d-4493-88de-333a1f340c20
46962024-11-19T02:19:46.340ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
46972024-11-19T02:19:46.340ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
46982024-11-19T02:19:46.340ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46992024-11-19T02:19:46.340ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
47002024-11-19T02:19:46.340ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
47012024-11-19T02:19:46.340ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
47022024-11-19T02:19:46.340ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
47032024-11-19T02:19:46.340ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
47042024-11-19T02:19:46.341ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
47052024-11-19T02:19:46.341ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47062024-11-19T02:19:46.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47072024-11-19T02:19:46.342ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
47082024-11-19T02:19:46.342ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
47092024-11-19T02:19:46.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
47102024-11-19T02:19:46.343ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
47112024-11-19T02:19:46.343ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "10694b0c-43cd-42bc-a01e-8a8e9b3821a2", "content-length": "2", "date": "Tue, 19 Nov 2024 02:19:45 GMT"} })
47122024-11-19T02:19:46.343ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
47132024-11-19T02:19:46.343ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "e645464f-70b7-466c-938d-569eca0fc6d1", "content-length": "52", "date": "Tue, 19 Nov 2024 02:19:45 GMT"} })
47142024-11-19T02:19:46.343ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0
47152024-11-19T02:19:46.343ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
47162024-11-19T02:19:46.344ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
47172024-11-19T02:19:46.344ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 1a01f5db-28b0-4d53-93f3-b21792e75a0f, kind: Service { id: 91bdcbd0-987b-49c4-8200-fc3e8f332b6b }, name: Name("external-dns-91bdcbd0-987b-49c4-8200-fc3e8f332b6b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 175])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 44aaf11d-41cc-4bfe-af84-bade0c866c36, kind: Service { id: 27d1a6ca-1b76-4956-aefa-e234c7d60cd0 }, name: Name("external-dns-27d1a6ca-1b76-4956-aefa-e234c7d60cd0"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 29b1632f-5910-4287-a228-0a2f072906c2, kind: Service { id: f02be878-8b16-4056-a261-089d083d36be }, name: Name("nexus-f02be878-8b16-4056-a261-089d083d36be"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 62])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ace3f45b-d569-4037-91af-4f9560e3857e, kind: Service { id: 9f0b435f-0000-451e-9dbc-dcec71543c30 }, name: Name("nexus-9f0b435f-0000-451e-9dbc-dcec71543c30"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 230])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f794593b-f8ae-411e-9836-93b29d4ba7a6, kind: Service { id: d90c9eb7-7c7e-4675-94ca-7779e9afc6c6 }, name: Name("nexus-d90c9eb7-7c7e-4675-94ca-7779e9afc6c6"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 194])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
47182024-11-19T02:19:46.344ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
47192024-11-19T02:19:46.381ZINFOnexus: assigned collector to new producer collector_id = 3980dd20-a3be-40d3-b9e5-094b8ed4b785 file = nexus/src/app/oximeter.rs:76 producer_id = 8e12c1ab-c863-4549-add8-1474df60b506
47202024-11-19T02:19:46.381ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48863 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48056 req_id = 0a27ff0a-c12e-45b9-b577-db7385539a36 response_code = 201 uri = /metrics/producers
47212024-11-19T02:19:46.410ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: ffe74824-0c08-48e1-a755-fb123e8dc181, time_created: 2024-11-19T02:10:26.061586Z, time_modified: 2024-11-19T02:10:26.061586Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: a894e92e-d765-4f15-b6b7-cb9ca46d1860, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
47222024-11-19T02:19:46.410ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
47232024-11-19T02:19:46.410ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
47242024-11-19T02:19:46.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
47252024-11-19T02:19:46.411ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
47262024-11-19T02:19:46.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
47272024-11-19T02:19:46.413ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47282024-11-19T02:19:46.417ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: ffe74824-0c08-48e1-a755-fb123e8dc181, lookup_type: ById(ffe74824-0c08-48e1-a755-fb123e8dc181) } result = Ok(())
47292024-11-19T02:19:46.457ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
47302024-11-19T02:19:46.467ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "78456e7d-195b-4437-9ddb-5784c7a8f5dd", "date": "Tue, 19 Nov 2024 02:19:46 GMT"} })
47312024-11-19T02:19:46.468ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
47322024-11-19T02:19:46.468ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 743.254047ms
47332024-11-19T02:19:46.468ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 743.261957ms iteration = 3 status = {}
47342024-11-19T02:19:46.477ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "831ad04b-f86c-4597-a3b7-88987c744e11", "date": "Tue, 19 Nov 2024 02:19:46 GMT"} })
47352024-11-19T02:19:46.477ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch = Switch0
47362024-11-19T02:19:46.477ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
47372024-11-19T02:19:46.477ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "298af122-ec00-4df9-9895-fbbf368bb204", "content-length": "682", "date": "Tue, 19 Nov 2024 02:19:46 GMT"} })
47382024-11-19T02:19:46.477ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47392024-11-19T02:19:46.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47402024-11-19T02:19:46.482ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47412024-11-19T02:19:46.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47422024-11-19T02:19:46.486ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47432024-11-19T02:19:46.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47442024-11-19T02:19:46.488ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47452024-11-19T02:19:46.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47462024-11-19T02:19:46.495ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 771.178926ms iteration = 21 status = {}
47472024-11-19T02:19:46.579ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "3568b9e2-50ec-47fb-8696-15b720a92021", "content-length": "30761", "date": "Tue, 19 Nov 2024 02:19:46 GMT"} })
47482024-11-19T02:19:46.582ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
47492024-11-19T02:19:46.582ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
47502024-11-19T02:19:46.582ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
47512024-11-19T02:19:46.584ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
47522024-11-19T02:19:46.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
47532024-11-19T02:19:46.585ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47542024-11-19T02:19:46.587ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
47552024-11-19T02:19:46.587ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
47562024-11-19T02:19:46.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
47572024-11-19T02:19:46.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 07c7e750-330a-40e7-8727-59dffed65293 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
47582024-11-19T02:19:46.680ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 07c7e750-330a-40e7-8727-59dffed65293 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
47592024-11-19T02:19:46.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2274 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 07c7e750-330a-40e7-8727-59dffed65293 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
47602024-11-19T02:19:46.766ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 0f2b521d-1016-47fe-959b-122b88c65535 file = nexus/db-queries/src/db/datastore/inventory.rs:1000
47612024-11-19T02:19:46.766ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 0f2b521d-1016-47fe-959b-122b88c65535 time_started = 2024-11-19 02:19:46.118469 UTC
47622024-11-19T02:19:46.766ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.041565822s iteration = 4 status = {"collection_id":"0f2b521d-1016-47fe-959b-122b88c65535","time_done":"2024-11-19 02:19:46.582245 UTC","time_started":"2024-11-19 02:19:46.118469 UTC"}
47632024-11-19T02:19:46.766ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Dependency
47642024-11-19T02:19:46.766ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47652024-11-19T02:19:46.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47662024-11-19T02:19:46.768ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47672024-11-19T02:19:46.770ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
47682024-11-19T02:19:46.770ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47692024-11-19T02:19:46.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47702024-11-19T02:19:46.772ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47712024-11-19T02:19:46.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47722024-11-19T02:19:46.774ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47732024-11-19T02:19:46.776ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
47742024-11-19T02:19:46.776ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47752024-11-19T02:19:46.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47762024-11-19T02:19:46.838ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 72.078385ms iteration = 25 status = {"physical_disks_added":0}
47772024-11-19T02:19:46.973ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = dd6fdde0-a4ea-4d06-b8c6-1cfe89ecb314 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
47782024-11-19T02:19:46.973ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = dd6fdde0-a4ea-4d06-b8c6-1cfe89ecb314 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
47792024-11-19T02:19:46.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3617 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = dd6fdde0-a4ea-4d06-b8c6-1cfe89ecb314 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
47802024-11-19T02:19:47.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6a9a9b38-e057-4f7d-ad57-ac67bccf8dbf roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
47812024-11-19T02:19:47.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6a9a9b38-e057-4f7d-ad57-ac67bccf8dbf resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
47822024-11-19T02:19:47.711ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2082 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6a9a9b38-e057-4f7d-ad57-ac67bccf8dbf response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
47832024-11-19T02:19:48.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9f8b07ab-7f10-49c4-9bb5-eb5afb86fcd8 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
47842024-11-19T02:19:48.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9f8b07ab-7f10-49c4-9bb5-eb5afb86fcd8 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
47852024-11-19T02:19:48.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2336 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9f8b07ab-7f10-49c4-9bb5-eb5afb86fcd8 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
47862024-11-19T02:19:48.737ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:63802
47872024-11-19T02:19:48.737ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:63802 req_id = 9c2f1177-45d2-4092-b815-ecba72560a30 roles = RoleSet { roles: {} } uri = /metrics/producers
47882024-11-19T02:19:48.737ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:63802 req_id = 9c2f1177-45d2-4092-b815-ecba72560a30 resource = Database result = Ok(()) uri = /metrics/producers
47892024-11-19T02:19:48.740ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:35472
47902024-11-19T02:19:48.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35472 req_id = 0df9d398-70d8-4249-99ee-df2d56558007 roles = RoleSet { roles: {} } uri = /metrics/producers
47912024-11-19T02:19:48.741ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35472 req_id = 0df9d398-70d8-4249-99ee-df2d56558007 resource = Database result = Ok(()) uri = /metrics/producers
47922024-11-19T02:19:48.745ZINFOnexus: assigned collector to new producer collector_id = 3980dd20-a3be-40d3-b9e5-094b8ed4b785 file = nexus/src/app/oximeter.rs:76 producer_id = ddf2e18a-a42b-49da-ad7e-ae7886578501
47932024-11-19T02:19:48.745ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7860 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:63802 req_id = 9c2f1177-45d2-4092-b815-ecba72560a30 response_code = 201 uri = /metrics/producers
47942024-11-19T02:19:48.778ZINFOnexus: assigned collector to new producer collector_id = 3980dd20-a3be-40d3-b9e5-094b8ed4b785 file = nexus/src/app/oximeter.rs:76 producer_id = 4f0e9442-b890-4bd0-8290-362b3608ea68
47952024-11-19T02:19:48.778ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37623 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35472 req_id = 0df9d398-70d8-4249-99ee-df2d56558007 response_code = 201 uri = /metrics/producers
47962024-11-19T02:19:49.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ecd84f6b-7798-41f8-b8dd-9fb89443c80f roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
47972024-11-19T02:19:49.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ecd84f6b-7798-41f8-b8dd-9fb89443c80f resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
47982024-11-19T02:19:49.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2508 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ecd84f6b-7798-41f8-b8dd-9fb89443c80f response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
47992024-11-19T02:19:50.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = bccf239f-2b3a-46cc-9186-9ebc8dfe46f2 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
48002024-11-19T02:19:50.782ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = bccf239f-2b3a-46cc-9186-9ebc8dfe46f2 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
48012024-11-19T02:19:50.784ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2030 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = bccf239f-2b3a-46cc-9186-9ebc8dfe46f2 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
48022024-11-19T02:19:51.807ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a0149a79-567d-4a37-a14a-7cba13e2d276 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
48032024-11-19T02:19:51.807ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a0149a79-567d-4a37-a14a-7cba13e2d276 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
48042024-11-19T02:19:51.809ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1997 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a0149a79-567d-4a37-a14a-7cba13e2d276 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
48052024-11-19T02:19:52.152ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1270 local_addr = [fd00:1122:3344:101::c]:60807 method = GET remote_addr = [fd00:1122:3344:101::d]:57844 req_id = 4c242e87-8b2f-42f3-a78a-74ae85af4261 response_code = 200 uri = /9f0b435f-0000-451e-9dbc-dcec71543c30
48062024-11-19T02:19:52.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 24c27c51-a9cc-4e58-8622-5ab57d77e50d roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
48072024-11-19T02:19:52.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 24c27c51-a9cc-4e58-8622-5ab57d77e50d resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
48082024-11-19T02:19:52.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2177 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 24c27c51-a9cc-4e58-8622-5ab57d77e50d response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
48092024-11-19T02:19:53.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 14c30365-cd50-4499-b8c3-cc4595d1f3e2 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
48102024-11-19T02:19:53.858ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 14c30365-cd50-4499-b8c3-cc4595d1f3e2 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
48112024-11-19T02:19:53.860ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2935 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 14c30365-cd50-4499-b8c3-cc4595d1f3e2 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
48122024-11-19T02:19:54.882ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9786a529-810a-4349-82e8-b074cb332e2a roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
48132024-11-19T02:19:54.883ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9786a529-810a-4349-82e8-b074cb332e2a resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
48142024-11-19T02:19:54.884ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2221 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9786a529-810a-4349-82e8-b074cb332e2a response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
48152024-11-19T02:19:55.725ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
48162024-11-19T02:19:55.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48172024-11-19T02:19:55.725ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
48182024-11-19T02:19:55.725ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48192024-11-19T02:19:55.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48202024-11-19T02:19:55.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48212024-11-19T02:19:55.727ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48222024-11-19T02:19:55.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48232024-11-19T02:19:55.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48242024-11-19T02:19:55.729ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.529952ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
48252024-11-19T02:19:55.730ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
48262024-11-19T02:19:55.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48272024-11-19T02:19:55.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48282024-11-19T02:19:55.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48292024-11-19T02:19:55.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48302024-11-19T02:19:55.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48312024-11-19T02:19:55.736ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
48322024-11-19T02:19:55.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48332024-11-19T02:19:55.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48342024-11-19T02:19:55.746ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
48352024-11-19T02:19:55.746ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.291673ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
48362024-11-19T02:19:55.906ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e51e8078-91bc-49fc-998e-7c9f7279c075 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
48372024-11-19T02:19:55.906ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e51e8078-91bc-49fc-998e-7c9f7279c075 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
48382024-11-19T02:19:55.907ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1459 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e51e8078-91bc-49fc-998e-7c9f7279c075 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
48392024-11-19T02:19:56.930ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = fc9b8cea-9a75-4b43-9c2e-5c1604233cfe roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
48402024-11-19T02:19:56.930ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = fc9b8cea-9a75-4b43-9c2e-5c1604233cfe resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
48412024-11-19T02:19:56.932ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2303 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = fc9b8cea-9a75-4b43-9c2e-5c1604233cfe response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
48422024-11-19T02:19:57.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = a86abf2e-f4dc-4074-b2b7-16172006a18a roles = RoleSet { roles: {} } uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?sort_by=id_ascending
48432024-11-19T02:19:57.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = a86abf2e-f4dc-4074-b2b7-16172006a18a resource = Database result = Ok(()) uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?sort_by=id_ascending
48442024-11-19T02:19:57.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3031 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = a86abf2e-f4dc-4074-b2b7-16172006a18a response_code = 200 uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?sort_by=id_ascending
48452024-11-19T02:19:57.148ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = 004a7cf7-2176-4476-8014-e6075a429431 roles = RoleSet { roles: {} } uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZmU3NDgyNC0wYzA4LTQ4ZTEtYTc1NS1mYjEyM2U4ZGMxODEifX0%3D
48462024-11-19T02:19:57.148ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = 004a7cf7-2176-4476-8014-e6075a429431 resource = Database result = Ok(()) uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZmU3NDgyNC0wYzA4LTQ4ZTEtYTc1NS1mYjEyM2U4ZGMxODEifX0%3D
48472024-11-19T02:19:57.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2663 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = 004a7cf7-2176-4476-8014-e6075a429431 response_code = 200 uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZmU3NDgyNC0wYzA4LTQ4ZTEtYTc1NS1mYjEyM2U4ZGMxODEifX0%3D
48482024-11-19T02:19:57.954ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 1000a70b-756f-4885-952b-d6b14df65d99 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
48492024-11-19T02:19:57.954ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 1000a70b-756f-4885-952b-d6b14df65d99 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
48502024-11-19T02:19:57.956ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2477 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 1000a70b-756f-4885-952b-d6b14df65d99 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
48512024-11-19T02:19:58.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a64f42d9-222c-445c-9c3e-cdaa4f3c891c roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
48522024-11-19T02:19:58.980ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a64f42d9-222c-445c-9c3e-cdaa4f3c891c resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
48532024-11-19T02:19:58.981ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2018 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a64f42d9-222c-445c-9c3e-cdaa4f3c891c response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
48542024-11-19T02:20:00.003ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0a4465e3-d6aa-4dae-9647-a07bce321403 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
48552024-11-19T02:20:00.003ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0a4465e3-d6aa-4dae-9647-a07bce321403 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
48562024-11-19T02:20:00.005ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1991 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0a4465e3-d6aa-4dae-9647-a07bce321403 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
48572024-11-19T02:20:01.027ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6c35929b-9e29-4590-a778-6b8dcb90b9fc roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
48582024-11-19T02:20:01.027ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6c35929b-9e29-4590-a778-6b8dcb90b9fc resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
48592024-11-19T02:20:01.029ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2118 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6c35929b-9e29-4590-a778-6b8dcb90b9fc response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
48602024-11-19T02:20:02.053ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 023f3332-0392-4f6c-abf1-54936d6c6fa1 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
48612024-11-19T02:20:02.053ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 023f3332-0392-4f6c-abf1-54936d6c6fa1 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
48622024-11-19T02:20:02.055ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2640 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 023f3332-0392-4f6c-abf1-54936d6c6fa1 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
48632024-11-19T02:20:03.077ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 1e3708db-929b-411b-9067-b5a640b0addb roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
48642024-11-19T02:20:03.077ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 1e3708db-929b-411b-9067-b5a640b0addb resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
48652024-11-19T02:20:03.079ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2001 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 1e3708db-929b-411b-9067-b5a640b0addb response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
48662024-11-19T02:20:04.102ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = f044a1d1-ffe0-43f1-91f3-6d9b74deca06 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
48672024-11-19T02:20:04.102ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = f044a1d1-ffe0-43f1-91f3-6d9b74deca06 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
48682024-11-19T02:20:04.104ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2017 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = f044a1d1-ffe0-43f1-91f3-6d9b74deca06 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
48692024-11-19T02:20:05.127ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 148827b2-33e6-4141-8c6c-fa25c9fba35e roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
48702024-11-19T02:20:05.128ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 148827b2-33e6-4141-8c6c-fa25c9fba35e resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
48712024-11-19T02:20:05.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2032 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 148827b2-33e6-4141-8c6c-fa25c9fba35e response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
48722024-11-19T02:20:05.725ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
48732024-11-19T02:20:05.725ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
48742024-11-19T02:20:05.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48752024-11-19T02:20:05.725ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48762024-11-19T02:20:05.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48772024-11-19T02:20:05.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48782024-11-19T02:20:05.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48792024-11-19T02:20:05.728ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48802024-11-19T02:20:05.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48812024-11-19T02:20:05.730ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.791585ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
48822024-11-19T02:20:05.730ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
48832024-11-19T02:20:05.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48842024-11-19T02:20:05.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48852024-11-19T02:20:05.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48862024-11-19T02:20:05.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48872024-11-19T02:20:05.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48882024-11-19T02:20:05.737ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
48892024-11-19T02:20:05.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48902024-11-19T02:20:05.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48912024-11-19T02:20:05.751ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
48922024-11-19T02:20:05.751ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.791555ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
48932024-11-19T02:20:06.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 251acd6d-6935-482a-81f9-2a4d220c057e roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
48942024-11-19T02:20:06.151ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 251acd6d-6935-482a-81f9-2a4d220c057e resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
48952024-11-19T02:20:06.153ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2129 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 251acd6d-6935-482a-81f9-2a4d220c057e response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
48962024-11-19T02:20:07.154ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1393 local_addr = [fd00:1122:3344:101::c]:60807 method = GET remote_addr = [fd00:1122:3344:101::d]:57844 req_id = 839922a7-32fc-4167-857b-0604673a1cd2 response_code = 200 uri = /9f0b435f-0000-451e-9dbc-dcec71543c30
48972024-11-19T02:20:07.174ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c73d3344-ea06-48a0-8d19-e33b0329252f roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
48982024-11-19T02:20:07.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c73d3344-ea06-48a0-8d19-e33b0329252f resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
48992024-11-19T02:20:07.177ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2823 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c73d3344-ea06-48a0-8d19-e33b0329252f response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
49002024-11-19T02:20:08.201ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 31e97203-0ff3-4743-a95a-9207136bd768 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
49012024-11-19T02:20:08.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 31e97203-0ff3-4743-a95a-9207136bd768 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
49022024-11-19T02:20:08.203ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1646 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 31e97203-0ff3-4743-a95a-9207136bd768 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
49032024-11-19T02:20:09.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e514c874-fcf1-4566-9f49-ff0719fa341f roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
49042024-11-19T02:20:09.227ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e514c874-fcf1-4566-9f49-ff0719fa341f resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
49052024-11-19T02:20:09.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3483 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e514c874-fcf1-4566-9f49-ff0719fa341f response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
49062024-11-19T02:20:10.259ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 50241e7a-e9d3-44fc-8cec-1d8e30e72667 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
49072024-11-19T02:20:10.259ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 50241e7a-e9d3-44fc-8cec-1d8e30e72667 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
49082024-11-19T02:20:10.261ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2391 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 50241e7a-e9d3-44fc-8cec-1d8e30e72667 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
49092024-11-19T02:20:11.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d5455b63-6a71-4965-b089-69a750f94032 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
49102024-11-19T02:20:11.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d5455b63-6a71-4965-b089-69a750f94032 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
49112024-11-19T02:20:11.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2501 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d5455b63-6a71-4965-b089-69a750f94032 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
49122024-11-19T02:20:12.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = 0a67d110-77cb-4b1f-bb4f-00e5f1240098 roles = RoleSet { roles: {} } uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?sort_by=id_ascending
49132024-11-19T02:20:12.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = 0a67d110-77cb-4b1f-bb4f-00e5f1240098 resource = Database result = Ok(()) uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?sort_by=id_ascending
49142024-11-19T02:20:12.149ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3529 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = 0a67d110-77cb-4b1f-bb4f-00e5f1240098 response_code = 200 uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?sort_by=id_ascending
49152024-11-19T02:20:12.149ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = 63db1837-de2f-43ee-a425-84d4a29967e0 roles = RoleSet { roles: {} } uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZmU3NDgyNC0wYzA4LTQ4ZTEtYTc1NS1mYjEyM2U4ZGMxODEifX0%3D
49162024-11-19T02:20:12.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = 63db1837-de2f-43ee-a425-84d4a29967e0 resource = Database result = Ok(()) uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZmU3NDgyNC0wYzA4LTQ4ZTEtYTc1NS1mYjEyM2U4ZGMxODEifX0%3D
49172024-11-19T02:20:12.152ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2767 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = 63db1837-de2f-43ee-a425-84d4a29967e0 response_code = 200 uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZmU3NDgyNC0wYzA4LTQ4ZTEtYTc1NS1mYjEyM2U4ZGMxODEifX0%3D
49182024-11-19T02:20:12.308ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 118c1630-fb4c-4df8-b087-7b14965e72ff roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
49192024-11-19T02:20:12.308ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 118c1630-fb4c-4df8-b087-7b14965e72ff resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
49202024-11-19T02:20:12.310ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2449 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 118c1630-fb4c-4df8-b087-7b14965e72ff response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
49212024-11-19T02:20:13.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 916d9896-60ea-431b-b887-6a77f2dfeed5 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
49222024-11-19T02:20:13.334ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 916d9896-60ea-431b-b887-6a77f2dfeed5 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
49232024-11-19T02:20:13.335ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2339 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 916d9896-60ea-431b-b887-6a77f2dfeed5 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
49242024-11-19T02:20:14.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b518d5ec-7c42-48c4-867f-a368c3bf79cc roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
49252024-11-19T02:20:14.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b518d5ec-7c42-48c4-867f-a368c3bf79cc resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
49262024-11-19T02:20:14.359ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2205 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b518d5ec-7c42-48c4-867f-a368c3bf79cc response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
49272024-11-19T02:20:15.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 7034a29d-8e99-4334-8950-85dfbff9a0d0 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
49282024-11-19T02:20:15.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 7034a29d-8e99-4334-8950-85dfbff9a0d0 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
49292024-11-19T02:20:15.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2538 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 7034a29d-8e99-4334-8950-85dfbff9a0d0 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
49302024-11-19T02:20:15.724ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
49312024-11-19T02:20:15.724ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
49322024-11-19T02:20:15.724ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
49332024-11-19T02:20:15.724ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
49342024-11-19T02:20:15.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
49352024-11-19T02:20:15.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
49362024-11-19T02:20:15.725ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
49372024-11-19T02:20:15.725ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
49382024-11-19T02:20:15.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
49392024-11-19T02:20:15.725ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
49402024-11-19T02:20:15.725ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
49412024-11-19T02:20:15.725ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49422024-11-19T02:20:15.725ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
49432024-11-19T02:20:15.725ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
49442024-11-19T02:20:15.725ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
49452024-11-19T02:20:15.725ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
49462024-11-19T02:20:15.725ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49472024-11-19T02:20:15.725ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49482024-11-19T02:20:15.725ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
49492024-11-19T02:20:15.725ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
49502024-11-19T02:20:15.725ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
49512024-11-19T02:20:15.725ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
49522024-11-19T02:20:15.725ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
49532024-11-19T02:20:15.725ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
49542024-11-19T02:20:15.725ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
49552024-11-19T02:20:15.725ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
49562024-11-19T02:20:15.725ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
49572024-11-19T02:20:15.725ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
49582024-11-19T02:20:15.725ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49592024-11-19T02:20:15.725ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
49602024-11-19T02:20:15.725ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
49612024-11-19T02:20:15.725ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
49622024-11-19T02:20:15.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49632024-11-19T02:20:15.725ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
49642024-11-19T02:20:15.725ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49652024-11-19T02:20:15.725ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
49662024-11-19T02:20:15.725ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49672024-11-19T02:20:15.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
49682024-11-19T02:20:15.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
49692024-11-19T02:20:15.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49702024-11-19T02:20:15.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
49712024-11-19T02:20:15.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49722024-11-19T02:20:15.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49732024-11-19T02:20:15.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49742024-11-19T02:20:15.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49752024-11-19T02:20:15.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
49762024-11-19T02:20:15.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49772024-11-19T02:20:15.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
49782024-11-19T02:20:15.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49792024-11-19T02:20:15.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
49802024-11-19T02:20:15.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49812024-11-19T02:20:15.727ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1513, tv_nsec: 511841370 } })
49822024-11-19T02:20:15.727ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1513, tv_nsec: 512051002 } })
49832024-11-19T02:20:15.727ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
49842024-11-19T02:20:15.727ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
49852024-11-19T02:20:15.728ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49862024-11-19T02:20:15.729ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.673622ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
49872024-11-19T02:20:15.729ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.035396ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
49882024-11-19T02:20:15.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49892024-11-19T02:20:15.730ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49902024-11-19T02:20:15.730ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
49912024-11-19T02:20:15.730ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49922024-11-19T02:20:15.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49932024-11-19T02:20:15.731ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
49942024-11-19T02:20:15.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
49952024-11-19T02:20:15.732ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
49962024-11-19T02:20:15.732ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
49972024-11-19T02:20:15.732ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
49982024-11-19T02:20:15.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49992024-11-19T02:20:15.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
50002024-11-19T02:20:15.732ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50012024-11-19T02:20:15.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50022024-11-19T02:20:15.733ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50032024-11-19T02:20:15.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
50042024-11-19T02:20:15.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50052024-11-19T02:20:15.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50062024-11-19T02:20:15.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50072024-11-19T02:20:15.735ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50082024-11-19T02:20:15.735ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50092024-11-19T02:20:15.738ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
50102024-11-19T02:20:15.738ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
50112024-11-19T02:20:15.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
50122024-11-19T02:20:15.739ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
50132024-11-19T02:20:15.739ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50142024-11-19T02:20:15.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50152024-11-19T02:20:15.739ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50162024-11-19T02:20:15.740ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50172024-11-19T02:20:15.742ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
50182024-11-19T02:20:15.742ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50192024-11-19T02:20:15.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50202024-11-19T02:20:15.743ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
50212024-11-19T02:20:15.743ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50222024-11-19T02:20:15.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50232024-11-19T02:20:15.743ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50242024-11-19T02:20:15.743ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
50252024-11-19T02:20:15.743ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50262024-11-19T02:20:15.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50272024-11-19T02:20:15.743ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1513, tv_nsec: 528616682 } })
50282024-11-19T02:20:15.744ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
50292024-11-19T02:20:15.744ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 19.291281ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
50302024-11-19T02:20:15.745ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50312024-11-19T02:20:15.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50322024-11-19T02:20:15.746ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50332024-11-19T02:20:15.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50342024-11-19T02:20:15.746ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50352024-11-19T02:20:15.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50362024-11-19T02:20:15.747ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50372024-11-19T02:20:15.748ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50382024-11-19T02:20:15.750ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
50392024-11-19T02:20:15.750ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50402024-11-19T02:20:15.751ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
50412024-11-19T02:20:15.751ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50422024-11-19T02:20:15.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50432024-11-19T02:20:15.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50442024-11-19T02:20:15.767ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
50452024-11-19T02:20:15.767ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 41.93218ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
50462024-11-19T02:20:15.767ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
50472024-11-19T02:20:15.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
50482024-11-19T02:20:15.769ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 43.737441ms iteration = 22 status = {"errors":[],"records_set_to_done":[]}
50492024-11-19T02:20:15.773ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 48.642957ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
50502024-11-19T02:20:15.778ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50512024-11-19T02:20:15.778ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
50522024-11-19T02:20:15.778ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 52.696353ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
50532024-11-19T02:20:15.778ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50542024-11-19T02:20:15.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50552024-11-19T02:20:15.780ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
50562024-11-19T02:20:15.780ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
50572024-11-19T02:20:15.780ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 55.297113ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
50582024-11-19T02:20:15.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
50592024-11-19T02:20:15.842ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50602024-11-19T02:20:15.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50612024-11-19T02:20:15.847ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 122.116418ms iteration = 26 status = {"physical_disks_added":0}
50622024-11-19T02:20:15.863ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 zone_address = fd00:1122:3344:101::2
50632024-11-19T02:20:15.863ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50642024-11-19T02:20:15.863ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e4de8ee1-17b3-49d2-8ba7-c88dec3779d5", "content-length": "26", "date": "Tue, 19 Nov 2024 02:20:15 GMT"} })
50652024-11-19T02:20:15.863ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50662024-11-19T02:20:15.866ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
50672024-11-19T02:20:15.866ZINFOnexus (BackgroundTasks): VPC route manager sled ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
50682024-11-19T02:20:15.866ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
50692024-11-19T02:20:15.867ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "f48eea88-379c-4941-b294-58d88fae2be2", "content-length": "372", "date": "Tue, 19 Nov 2024 02:20:15 GMT"} })
50702024-11-19T02:20:15.867ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50712024-11-19T02:20:15.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50722024-11-19T02:20:15.868ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
50732024-11-19T02:20:15.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
50742024-11-19T02:20:15.869ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50752024-11-19T02:20:15.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50762024-11-19T02:20:15.871ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50772024-11-19T02:20:15.874ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: ffe74824-0c08-48e1-a755-fb123e8dc181, lookup_type: ById(ffe74824-0c08-48e1-a755-fb123e8dc181) } result = Ok(())
50782024-11-19T02:20:15.874ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50792024-11-19T02:20:15.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50802024-11-19T02:20:15.876ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 150.836587ms iteration = 22 status = 0
50812024-11-19T02:20:15.898ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 172.674066ms iteration = 22 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
50822024-11-19T02:20:15.900ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 175.038344ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
50832024-11-19T02:20:15.905ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50842024-11-19T02:20:15.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50852024-11-19T02:20:15.907ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50862024-11-19T02:20:15.910ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
50872024-11-19T02:20:15.910ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50882024-11-19T02:20:15.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50892024-11-19T02:20:15.912ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50902024-11-19T02:20:15.915ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
50912024-11-19T02:20:15.915ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
50922024-11-19T02:20:15.915ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "368492f6-e989-4959-914d-33209b4f8198", "date": "Tue, 19 Nov 2024 02:20:15 GMT"} })
50932024-11-19T02:20:15.915ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50942024-11-19T02:20:15.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50952024-11-19T02:20:15.915ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
50962024-11-19T02:20:15.915ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50972024-11-19T02:20:15.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50982024-11-19T02:20:15.921ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50992024-11-19T02:20:15.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51002024-11-19T02:20:15.925ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51012024-11-19T02:20:15.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51022024-11-19T02:20:15.929ZINFOnexus (BackgroundTasks): VPC route manager sled ffe74824-0c08-48e1-a755-fb123e8dc181 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
51032024-11-19T02:20:15.929ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
51042024-11-19T02:20:15.930ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "8c24ee9d-5d99-44f1-8368-e5a077f1cb77", "date": "Tue, 19 Nov 2024 02:20:15 GMT"} })
51052024-11-19T02:20:15.932ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 207.305413ms iteration = 23 status = {}
51062024-11-19T02:20:15.944ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
51072024-11-19T02:20:15.944ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
51082024-11-19T02:20:15.944ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8b3bd6fe-91d0-4199-bc6c-5c07fdddc3a7", "content-length": "26", "date": "Tue, 19 Nov 2024 02:20:15 GMT"} })
51092024-11-19T02:20:15.944ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
51102024-11-19T02:20:15.946ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
51112024-11-19T02:20:15.948ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
51122024-11-19T02:20:15.948ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
51132024-11-19T02:20:15.949ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1bad75a1-aaf3-4955-9909-5ad0834766d0", "content-length": "26", "date": "Tue, 19 Nov 2024 02:20:15 GMT"} })
51142024-11-19T02:20:15.949ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
51152024-11-19T02:20:15.951ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
51162024-11-19T02:20:16.027ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
51172024-11-19T02:20:16.028ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "7282341c-1d90-488f-8b59-e69d1587bd3d", "content-length": "691", "date": "Tue, 19 Nov 2024 02:20:15 GMT"} })
51182024-11-19T02:20:16.028ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
51192024-11-19T02:20:16.028ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
51202024-11-19T02:20:16.028ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
51212024-11-19T02:20:16.029ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 304.455965ms iteration = 22 status = {}
51222024-11-19T02:20:16.060ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 335.739053ms iteration = 22 status = {}
51232024-11-19T02:20:16.065ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
51242024-11-19T02:20:16.066ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "6bc186e0-507f-41c3-a8dd-76bb294ee25f", "content-length": "1", "date": "Tue, 19 Nov 2024 02:20:15 GMT"} })
51252024-11-19T02:20:16.069ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
51262024-11-19T02:20:16.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
51272024-11-19T02:20:16.077ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 353.217053ms iteration = 22 status = null
51282024-11-19T02:20:16.107ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51292024-11-19T02:20:16.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51302024-11-19T02:20:16.110ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 20bc3881-e2ee-4d8d-b84b-b0c1e478721f, rack_id: a894e92e-d765-4f15-b6b7-cb9ca46d1860, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8597d802-6d4d-4493-88de-333a1f340c20) } rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0
51312024-11-19T02:20:16.110ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51322024-11-19T02:20:16.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51332024-11-19T02:20:16.120ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
51342024-11-19T02:20:16.121ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "8fb0bf44-01df-41ed-a914-bd7197c0f684", "content-length": "134", "date": "Tue, 19 Nov 2024 02:20:15 GMT"} })
51352024-11-19T02:20:16.121ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
51362024-11-19T02:20:16.121ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8597d802-6d4d-4493-88de-333a1f340c20
51372024-11-19T02:20:16.121ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
51382024-11-19T02:20:16.121ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
51392024-11-19T02:20:16.121ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
51402024-11-19T02:20:16.121ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
51412024-11-19T02:20:16.121ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
51422024-11-19T02:20:16.121ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
51432024-11-19T02:20:16.121ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
51442024-11-19T02:20:16.121ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
51452024-11-19T02:20:16.122ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
51462024-11-19T02:20:16.122ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51472024-11-19T02:20:16.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51482024-11-19T02:20:16.123ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
51492024-11-19T02:20:16.124ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c0b51218-9a5b-4ba5-a183-4eaffafcb5da", "content-length": "2", "date": "Tue, 19 Nov 2024 02:20:15 GMT"} })
51502024-11-19T02:20:16.124ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
51512024-11-19T02:20:16.124ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "6bfd25c3-91ea-41ba-bda7-2ee8f8100f9f", "content-length": "52", "date": "Tue, 19 Nov 2024 02:20:15 GMT"} })
51522024-11-19T02:20:16.124ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0
51532024-11-19T02:20:16.124ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
51542024-11-19T02:20:16.244ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "c99ac860-c754-4e21-bc97-6f3f6fb86f54", "date": "Tue, 19 Nov 2024 02:20:15 GMT"} })
51552024-11-19T02:20:16.244ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch = Switch0
51562024-11-19T02:20:16.244ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
51572024-11-19T02:20:16.244ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "68e29c42-ce5e-4caa-b229-654112cc0eaf", "content-length": "682", "date": "Tue, 19 Nov 2024 02:20:16 GMT"} })
51582024-11-19T02:20:16.244ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51592024-11-19T02:20:16.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51602024-11-19T02:20:16.248ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51612024-11-19T02:20:16.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51622024-11-19T02:20:16.253ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51632024-11-19T02:20:16.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51642024-11-19T02:20:16.256ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51652024-11-19T02:20:16.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51662024-11-19T02:20:16.263ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 538.046328ms iteration = 22 status = {}
51672024-11-19T02:20:16.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4ddd1ab8-0ba4-4512-8811-f9b4f6ba2cc6 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
51682024-11-19T02:20:16.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4ddd1ab8-0ba4-4512-8811-f9b4f6ba2cc6 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
51692024-11-19T02:20:16.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1817 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4ddd1ab8-0ba4-4512-8811-f9b4f6ba2cc6 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
51702024-11-19T02:20:17.009ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = 39673dcb-dc83-438c-85c2-aa0833fdd7f5 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
51712024-11-19T02:20:17.009ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = 39673dcb-dc83-438c-85c2-aa0833fdd7f5 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
51722024-11-19T02:20:17.013ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3864 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = 39673dcb-dc83-438c-85c2-aa0833fdd7f5 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
51732024-11-19T02:20:17.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d71f07d3-cb43-4a4d-a84f-d95a50956550 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
51742024-11-19T02:20:17.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d71f07d3-cb43-4a4d-a84f-d95a50956550 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
51752024-11-19T02:20:17.429ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2411 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d71f07d3-cb43-4a4d-a84f-d95a50956550 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
51762024-11-19T02:20:18.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 1e367001-2691-4443-b997-a57bfe30bea3 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
51772024-11-19T02:20:18.451ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 1e367001-2691-4443-b997-a57bfe30bea3 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
51782024-11-19T02:20:18.453ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2617 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 1e367001-2691-4443-b997-a57bfe30bea3 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
51792024-11-19T02:20:19.475ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 78a2cf9c-d224-48e9-8876-13afc2123d84 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
51802024-11-19T02:20:19.475ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 78a2cf9c-d224-48e9-8876-13afc2123d84 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
51812024-11-19T02:20:19.477ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2344 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 78a2cf9c-d224-48e9-8876-13afc2123d84 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
51822024-11-19T02:20:20.500ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = af01c786-49d8-4f9f-9416-d87dc598d1b4 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
51832024-11-19T02:20:20.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = af01c786-49d8-4f9f-9416-d87dc598d1b4 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
51842024-11-19T02:20:20.502ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2387 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = af01c786-49d8-4f9f-9416-d87dc598d1b4 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
51852024-11-19T02:20:21.524ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = bcb17ec4-cee4-4754-8750-0902766e8630 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
51862024-11-19T02:20:21.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = bcb17ec4-cee4-4754-8750-0902766e8630 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
51872024-11-19T02:20:21.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2391 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = bcb17ec4-cee4-4754-8750-0902766e8630 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
51882024-11-19T02:20:22.154ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1674 local_addr = [fd00:1122:3344:101::c]:60807 method = GET remote_addr = [fd00:1122:3344:101::d]:57844 req_id = 712a67a5-3d78-48e1-b279-49f8203ab434 response_code = 200 uri = /9f0b435f-0000-451e-9dbc-dcec71543c30
51892024-11-19T02:20:22.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d52172a8-cd34-4284-97ff-e671a7baa501 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
51902024-11-19T02:20:22.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d52172a8-cd34-4284-97ff-e671a7baa501 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
51912024-11-19T02:20:22.552ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2353 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d52172a8-cd34-4284-97ff-e671a7baa501 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
51922024-11-19T02:20:23.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4c2645de-caf5-4577-8f40-dc20378f9a23 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
51932024-11-19T02:20:23.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4c2645de-caf5-4577-8f40-dc20378f9a23 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
51942024-11-19T02:20:23.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2164 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4c2645de-caf5-4577-8f40-dc20378f9a23 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
51952024-11-19T02:20:24.599ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 16516d45-80be-42d4-82fc-47521d5f713a roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
51962024-11-19T02:20:24.599ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 16516d45-80be-42d4-82fc-47521d5f713a resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
51972024-11-19T02:20:24.601ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2172 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 16516d45-80be-42d4-82fc-47521d5f713a response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
51982024-11-19T02:20:25.626ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d1b6a360-19c5-4c1a-89c3-30992719179e roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
51992024-11-19T02:20:25.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d1b6a360-19c5-4c1a-89c3-30992719179e resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
52002024-11-19T02:20:25.628ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2042 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d1b6a360-19c5-4c1a-89c3-30992719179e response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
52012024-11-19T02:20:25.726ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
52022024-11-19T02:20:25.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
52032024-11-19T02:20:25.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52042024-11-19T02:20:25.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52052024-11-19T02:20:25.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52062024-11-19T02:20:25.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52072024-11-19T02:20:25.755ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52082024-11-19T02:20:25.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52092024-11-19T02:20:25.755ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52102024-11-19T02:20:25.758ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52112024-11-19T02:20:25.758ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52122024-11-19T02:20:25.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52132024-11-19T02:20:25.760ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52142024-11-19T02:20:25.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52152024-11-19T02:20:25.762ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52162024-11-19T02:20:25.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
52172024-11-19T02:20:25.765ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52182024-11-19T02:20:25.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52192024-11-19T02:20:25.777ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
52202024-11-19T02:20:25.777ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 51.429909ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
52212024-11-19T02:20:25.785ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.290328ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52222024-11-19T02:20:26.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 056ed9bc-3c8c-4935-9592-3fec727db88c roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
52232024-11-19T02:20:26.651ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 056ed9bc-3c8c-4935-9592-3fec727db88c resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
52242024-11-19T02:20:26.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1987 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 056ed9bc-3c8c-4935-9592-3fec727db88c response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
52252024-11-19T02:20:27.674ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 739ef73f-8cd0-4c92-969d-7c9308fc3344 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
52262024-11-19T02:20:27.675ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 739ef73f-8cd0-4c92-969d-7c9308fc3344 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
52272024-11-19T02:20:27.676ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2516 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 739ef73f-8cd0-4c92-969d-7c9308fc3344 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
52282024-11-19T02:20:28.699ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e2e50948-8242-4996-a538-dca358344acf roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
52292024-11-19T02:20:28.699ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e2e50948-8242-4996-a538-dca358344acf resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
52302024-11-19T02:20:28.701ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2387 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e2e50948-8242-4996-a538-dca358344acf response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
52312024-11-19T02:20:29.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 73475caa-295f-4ccf-a0b2-064284b8d84a roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
52322024-11-19T02:20:29.724ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 73475caa-295f-4ccf-a0b2-064284b8d84a resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
52332024-11-19T02:20:29.725ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1649 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 73475caa-295f-4ccf-a0b2-064284b8d84a response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
52342024-11-19T02:20:30.354ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
52352024-11-19T02:20:30.354ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
52362024-11-19T02:20:30.385ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
52372024-11-19T02:20:30.385ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:55620
52382024-11-19T02:20:30.385ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:55620 req_id = a891c249-7feb-4869-9e1c-5dc6beb4fd43 roles = RoleSet { roles: {} } uri = /metrics/producers
52392024-11-19T02:20:30.386ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:55620 req_id = a891c249-7feb-4869-9e1c-5dc6beb4fd43 resource = Database result = Ok(()) uri = /metrics/producers
52402024-11-19T02:20:30.421ZINFOnexus: assigned collector to new producer collector_id = 3980dd20-a3be-40d3-b9e5-094b8ed4b785 file = nexus/src/app/oximeter.rs:76 producer_id = 9f0b435f-0000-451e-9dbc-dcec71543c30
52412024-11-19T02:20:30.421ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35949 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:55620 req_id = a891c249-7feb-4869-9e1c-5dc6beb4fd43 response_code = 201 uri = /metrics/producers
52422024-11-19T02:20:30.421ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "a891c249-7feb-4869-9e1c-5dc6beb4fd43", "content-length": "41", "date": "Tue, 19 Nov 2024 02:20:30 GMT"} })
52432024-11-19T02:20:30.424ZDEBGnexus (producer-registration-task): registered with nexus successfully
52442024-11-19T02:20:30.424ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
52452024-11-19T02:20:30.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 03aafbc3-197b-4aa6-b3af-460515ef10ab roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
52462024-11-19T02:20:30.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 03aafbc3-197b-4aa6-b3af-460515ef10ab resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
52472024-11-19T02:20:30.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2360 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 03aafbc3-197b-4aa6-b3af-460515ef10ab response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
52482024-11-19T02:20:31.771ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a1621be6-3c20-4b30-b8eb-cc93d6b02c60 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
52492024-11-19T02:20:31.771ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a1621be6-3c20-4b30-b8eb-cc93d6b02c60 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
52502024-11-19T02:20:31.773ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2595 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a1621be6-3c20-4b30-b8eb-cc93d6b02c60 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
52512024-11-19T02:20:32.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = fd85d120-f6b9-4d87-98cf-a1c7e4ca2d4e roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
52522024-11-19T02:20:32.796ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = fd85d120-f6b9-4d87-98cf-a1c7e4ca2d4e resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
52532024-11-19T02:20:32.798ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1824 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = fd85d120-f6b9-4d87-98cf-a1c7e4ca2d4e response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
52542024-11-19T02:20:33.819ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 33ac790b-3833-44b2-94f0-d6b76d2b7362 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
52552024-11-19T02:20:33.819ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 33ac790b-3833-44b2-94f0-d6b76d2b7362 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
52562024-11-19T02:20:33.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2106 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 33ac790b-3833-44b2-94f0-d6b76d2b7362 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
52572024-11-19T02:20:34.843ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 586216eb-d9e2-4e0a-a52a-5177f8f6acf8 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
52582024-11-19T02:20:34.844ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 586216eb-d9e2-4e0a-a52a-5177f8f6acf8 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
52592024-11-19T02:20:34.845ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2038 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 586216eb-d9e2-4e0a-a52a-5177f8f6acf8 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
52602024-11-19T02:20:35.725ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
52612024-11-19T02:20:35.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52622024-11-19T02:20:35.726ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
52632024-11-19T02:20:35.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52642024-11-19T02:20:35.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52652024-11-19T02:20:35.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52662024-11-19T02:20:35.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52672024-11-19T02:20:35.730ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52682024-11-19T02:20:35.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52692024-11-19T02:20:35.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52702024-11-19T02:20:35.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52712024-11-19T02:20:35.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52722024-11-19T02:20:35.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52732024-11-19T02:20:35.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
52742024-11-19T02:20:35.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52752024-11-19T02:20:35.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52762024-11-19T02:20:35.744ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
52772024-11-19T02:20:35.744ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.376411ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
52782024-11-19T02:20:35.755ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52792024-11-19T02:20:35.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52802024-11-19T02:20:35.756ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.021365ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52812024-11-19T02:20:35.867ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 2f76c011-8014-4986-a960-4bd0a6f6a4c0 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
52822024-11-19T02:20:35.867ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 2f76c011-8014-4986-a960-4bd0a6f6a4c0 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
52832024-11-19T02:20:35.869ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2221 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 2f76c011-8014-4986-a960-4bd0a6f6a4c0 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
52842024-11-19T02:20:36.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0d1fe9d4-8c67-46cd-b2f6-6b208148a175 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
52852024-11-19T02:20:36.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0d1fe9d4-8c67-46cd-b2f6-6b208148a175 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
52862024-11-19T02:20:36.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1980 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0d1fe9d4-8c67-46cd-b2f6-6b208148a175 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
52872024-11-19T02:20:37.153ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1298 local_addr = [fd00:1122:3344:101::c]:60807 method = GET remote_addr = [fd00:1122:3344:101::d]:57844 req_id = b147861f-d7bc-483c-8620-2ba5267be95a response_code = 200 uri = /9f0b435f-0000-451e-9dbc-dcec71543c30
52882024-11-19T02:20:37.914ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 50cb766d-18ed-4d3d-8897-7785d322a1e9 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
52892024-11-19T02:20:37.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 50cb766d-18ed-4d3d-8897-7785d322a1e9 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
52902024-11-19T02:20:37.916ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2029 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 50cb766d-18ed-4d3d-8897-7785d322a1e9 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
52912024-11-19T02:20:38.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 44f918da-1592-4f8c-b306-3fc66793e657 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
52922024-11-19T02:20:38.938ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 44f918da-1592-4f8c-b306-3fc66793e657 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
52932024-11-19T02:20:38.940ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2429 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 44f918da-1592-4f8c-b306-3fc66793e657 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
52942024-11-19T02:20:39.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 42ca14a7-1c1e-495f-86c1-2e3be7708420 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
52952024-11-19T02:20:39.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 42ca14a7-1c1e-495f-86c1-2e3be7708420 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
52962024-11-19T02:20:39.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2270 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 42ca14a7-1c1e-495f-86c1-2e3be7708420 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
52972024-11-19T02:20:40.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3dfa9062-8c03-4224-a9d6-5fed5550038b roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
52982024-11-19T02:20:40.985ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3dfa9062-8c03-4224-a9d6-5fed5550038b resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
52992024-11-19T02:20:40.987ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2097 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3dfa9062-8c03-4224-a9d6-5fed5550038b response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
53002024-11-19T02:20:42.011ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 48fe3e25-2a43-48c6-bd4a-ab0431bb642a roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
53012024-11-19T02:20:42.011ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 48fe3e25-2a43-48c6-bd4a-ab0431bb642a resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
53022024-11-19T02:20:42.013ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2179 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 48fe3e25-2a43-48c6-bd4a-ab0431bb642a response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
53032024-11-19T02:20:43.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = dc8bef7e-9803-4533-8e1a-f87acaecd370 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
53042024-11-19T02:20:43.035ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = dc8bef7e-9803-4533-8e1a-f87acaecd370 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
53052024-11-19T02:20:43.036ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1871 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = dc8bef7e-9803-4533-8e1a-f87acaecd370 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
53062024-11-19T02:20:44.058ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = be3e629d-f8a6-4264-9180-e950a871b3a1 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
53072024-11-19T02:20:44.058ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = be3e629d-f8a6-4264-9180-e950a871b3a1 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
53082024-11-19T02:20:44.060ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2381 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = be3e629d-f8a6-4264-9180-e950a871b3a1 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
53092024-11-19T02:20:45.083ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ac3eae70-3654-4e39-8139-a5d96f591e3f roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
53102024-11-19T02:20:45.083ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ac3eae70-3654-4e39-8139-a5d96f591e3f resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
53112024-11-19T02:20:45.085ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2398 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ac3eae70-3654-4e39-8139-a5d96f591e3f response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
53122024-11-19T02:20:45.724ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
53132024-11-19T02:20:45.724ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
53142024-11-19T02:20:45.724ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
53152024-11-19T02:20:45.724ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
53162024-11-19T02:20:45.724ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
53172024-11-19T02:20:45.724ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
53182024-11-19T02:20:45.724ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
53192024-11-19T02:20:45.724ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
53202024-11-19T02:20:45.724ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
53212024-11-19T02:20:45.724ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
53222024-11-19T02:20:45.724ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-19 02:10:45.724861121 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
53232024-11-19T02:20:45.724ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
53242024-11-19T02:20:45.724ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
53252024-11-19T02:20:45.724ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
53262024-11-19T02:20:45.724ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
53272024-11-19T02:20:45.724ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53282024-11-19T02:20:45.724ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
53292024-11-19T02:20:45.724ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
53302024-11-19T02:20:45.724ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53312024-11-19T02:20:45.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
53322024-11-19T02:20:45.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
53332024-11-19T02:20:45.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
53342024-11-19T02:20:45.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53352024-11-19T02:20:45.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
53362024-11-19T02:20:45.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53372024-11-19T02:20:45.725ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2d59cdb7-e3b1-4e94-afa3-f64f69928234.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a949a8d8-46c7-4423-b760-c03f98ccf638.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b190a9bf-d8b7-43c3-add4-e113c9b89870.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b190a9bf-d8b7-43c3-add4-e113c9b89870.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1543, tv_nsec: 509752606 } })
53382024-11-19T02:20:45.725ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
53392024-11-19T02:20:45.725ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
53402024-11-19T02:20:45.725ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
53412024-11-19T02:20:45.725ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53422024-11-19T02:20:45.725ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
53432024-11-19T02:20:45.725ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
53442024-11-19T02:20:45.725ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115
53452024-11-19T02:20:45.725ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
53462024-11-19T02:20:45.725ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 8.561\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115"}
53472024-11-19T02:20:45.725ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53482024-11-19T02:20:45.725ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
53492024-11-19T02:20:45.725ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
53502024-11-19T02:20:45.725ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
53512024-11-19T02:20:45.725ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
53522024-11-19T02:20:45.725ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
53532024-11-19T02:20:45.725ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53542024-11-19T02:20:45.725ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
53552024-11-19T02:20:45.725ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
53562024-11-19T02:20:45.725ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
53572024-11-19T02:20:45.725ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
53582024-11-19T02:20:45.725ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53592024-11-19T02:20:45.725ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
53602024-11-19T02:20:45.725ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53612024-11-19T02:20:45.725ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
53622024-11-19T02:20:45.725ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
53632024-11-19T02:20:45.725ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
53642024-11-19T02:20:45.725ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53652024-11-19T02:20:45.725ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
53662024-11-19T02:20:45.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53672024-11-19T02:20:45.725ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
53682024-11-19T02:20:45.725ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("27d1a6ca-1b76-4956-aefa-e234c7d60cd0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("91bdcbd0-987b-49c4-8200-fc3e8f332b6b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("91bdcbd0-987b-49c4-8200-fc3e8f332b6b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1543, tv_nsec: 509971959 } })
53692024-11-19T02:20:45.725ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
53702024-11-19T02:20:45.725ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
53712024-11-19T02:20:45.725ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
53722024-11-19T02:20:45.725ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
53732024-11-19T02:20:45.725ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53742024-11-19T02:20:45.725ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
53752024-11-19T02:20:45.725ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
53762024-11-19T02:20:45.725ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
53772024-11-19T02:20:45.725ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
53782024-11-19T02:20:45.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
53792024-11-19T02:20:45.725ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
53802024-11-19T02:20:45.725ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
53812024-11-19T02:20:45.725ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
53822024-11-19T02:20:45.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53832024-11-19T02:20:45.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
53842024-11-19T02:20:45.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53852024-11-19T02:20:45.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
53862024-11-19T02:20:45.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
53872024-11-19T02:20:45.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
53882024-11-19T02:20:45.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
53892024-11-19T02:20:45.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53902024-11-19T02:20:45.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53912024-11-19T02:20:45.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53922024-11-19T02:20:45.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
53932024-11-19T02:20:45.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
53942024-11-19T02:20:45.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53952024-11-19T02:20:45.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53962024-11-19T02:20:45.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
53972024-11-19T02:20:45.726ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
53982024-11-19T02:20:45.726ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.511868ms iteration = 13 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
53992024-11-19T02:20:45.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
54002024-11-19T02:20:45.726ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
54012024-11-19T02:20:45.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
54022024-11-19T02:20:45.726ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.476867ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
54032024-11-19T02:20:45.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
54042024-11-19T02:20:45.727ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
54052024-11-19T02:20:45.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
54062024-11-19T02:20:45.727ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54072024-11-19T02:20:45.727ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1543, tv_nsec: 511960731 } })
54082024-11-19T02:20:45.727ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54092024-11-19T02:20:45.728ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
54102024-11-19T02:20:45.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54112024-11-19T02:20:45.728ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-19 02:10:45.724861121 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
54122024-11-19T02:20:45.728ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.526921ms iteration = 12 status = {"expiration":"2024-11-19T02:10:45.724861121Z","pruned":[]}
54132024-11-19T02:20:45.729ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1543, tv_nsec: 513734262 } })
54142024-11-19T02:20:45.729ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
54152024-11-19T02:20:45.729ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54162024-11-19T02:20:45.729ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
54172024-11-19T02:20:45.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54182024-11-19T02:20:45.731ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54192024-11-19T02:20:45.732ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54202024-11-19T02:20:45.733ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 7.8552ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
54212024-11-19T02:20:45.733ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
54222024-11-19T02:20:45.733ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54232024-11-19T02:20:45.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54242024-11-19T02:20:45.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
54252024-11-19T02:20:45.735ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
54262024-11-19T02:20:45.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
54272024-11-19T02:20:45.735ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54282024-11-19T02:20:45.738ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
54292024-11-19T02:20:45.738ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
54302024-11-19T02:20:45.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
54312024-11-19T02:20:45.742ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 17.073155ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
54322024-11-19T02:20:45.745ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54332024-11-19T02:20:45.745ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54342024-11-19T02:20:45.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54352024-11-19T02:20:45.748ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
54362024-11-19T02:20:45.748ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54372024-11-19T02:20:45.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54382024-11-19T02:20:45.767ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54392024-11-19T02:20:45.769ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
54402024-11-19T02:20:45.769ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54412024-11-19T02:20:45.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54422024-11-19T02:20:45.774ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54432024-11-19T02:20:45.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54442024-11-19T02:20:45.776ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
54452024-11-19T02:20:45.776ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
54462024-11-19T02:20:45.776ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
54472024-11-19T02:20:45.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54482024-11-19T02:20:45.777ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54492024-11-19T02:20:45.779ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54502024-11-19T02:20:45.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54512024-11-19T02:20:45.780ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
54522024-11-19T02:20:45.780ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54532024-11-19T02:20:45.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54542024-11-19T02:20:45.784ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54552024-11-19T02:20:45.787ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54562024-11-19T02:20:45.787ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 62.138251ms iteration = 23 status = {"errors":[],"records_set_to_done":[]}
54572024-11-19T02:20:45.787ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 62.162882ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
54582024-11-19T02:20:45.789ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
54592024-11-19T02:20:45.789ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54602024-11-19T02:20:45.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54612024-11-19T02:20:45.789ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54622024-11-19T02:20:45.790ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
54632024-11-19T02:20:45.790ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
54642024-11-19T02:20:45.790ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
54652024-11-19T02:20:45.790ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 65.176416ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
54662024-11-19T02:20:45.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
54672024-11-19T02:20:45.791ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
54682024-11-19T02:20:45.791ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54692024-11-19T02:20:45.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54702024-11-19T02:20:45.792ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
54712024-11-19T02:20:45.792ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54722024-11-19T02:20:45.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54732024-11-19T02:20:45.794ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54742024-11-19T02:20:45.796ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
54752024-11-19T02:20:45.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
54762024-11-19T02:20:45.796ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
54772024-11-19T02:20:45.799ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
54782024-11-19T02:20:45.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
54792024-11-19T02:20:45.801ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54802024-11-19T02:20:45.801ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
54812024-11-19T02:20:45.801ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 76.240193ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
54822024-11-19T02:20:45.804ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
54832024-11-19T02:20:45.805ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
54842024-11-19T02:20:45.805ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
54852024-11-19T02:20:45.805ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 79.483589ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
54862024-11-19T02:20:45.808ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
54872024-11-19T02:20:45.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
54882024-11-19T02:20:45.824ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
54892024-11-19T02:20:45.825ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
54902024-11-19T02:20:45.825ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
54912024-11-19T02:20:45.825ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54922024-11-19T02:20:45.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54932024-11-19T02:20:45.826ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54942024-11-19T02:20:45.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54952024-11-19T02:20:45.832ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
54962024-11-19T02:20:45.832ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
54972024-11-19T02:20:45.832ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
54982024-11-19T02:20:45.832ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
54992024-11-19T02:20:45.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55002024-11-19T02:20:45.861ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
55012024-11-19T02:20:45.873ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
55022024-11-19T02:20:45.873ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55032024-11-19T02:20:45.874ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ef68b4d-15ee-4367-aede-e9a1e845ecbf", "content-length": "26", "date": "Tue, 19 Nov 2024 02:20:45 GMT"} })
55042024-11-19T02:20:45.874ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55052024-11-19T02:20:45.875ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
55062024-11-19T02:20:46.016ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
55072024-11-19T02:20:46.016ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "6ab906d1-b5f4-43b7-9424-1f0abb89df3e", "date": "Tue, 19 Nov 2024 02:20:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
55082024-11-19T02:20:46.016ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
55092024-11-19T02:20:46.018ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "315e5999-270c-4eb2-8eb6-57794b716d02", "date": "Tue, 19 Nov 2024 02:20:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
55102024-11-19T02:20:46.018ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
55112024-11-19T02:20:46.020ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
55122024-11-19T02:20:46.020ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 295.825926ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
55132024-11-19T02:20:46.030ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 306.098373ms iteration = 23 status = {}
55142024-11-19T02:20:46.043ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
55152024-11-19T02:20:46.043ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55162024-11-19T02:20:46.044ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e0b40904-c246-4788-b2cb-42266ec42717", "content-length": "26", "date": "Tue, 19 Nov 2024 02:20:45 GMT"} })
55172024-11-19T02:20:46.044ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55182024-11-19T02:20:46.046ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
55192024-11-19T02:20:46.058ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
55202024-11-19T02:20:46.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 5925be0c-8277-47cd-81ea-5828949435b4 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
55212024-11-19T02:20:46.107ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 5925be0c-8277-47cd-81ea-5828949435b4 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
55222024-11-19T02:20:46.116ZINFOnexus (BackgroundTasks): VPC route manager sled ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
55232024-11-19T02:20:46.116ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
55242024-11-19T02:20:46.117ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "65e8064f-cb8e-4847-88cc-073011d11512", "content-length": "372", "date": "Tue, 19 Nov 2024 02:20:46 GMT"} })
55252024-11-19T02:20:46.117ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55262024-11-19T02:20:46.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55272024-11-19T02:20:46.120ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
55282024-11-19T02:20:46.120ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
55292024-11-19T02:20:46.120ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
55302024-11-19T02:20:46.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
55312024-11-19T02:20:46.120ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55322024-11-19T02:20:46.123ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55332024-11-19T02:20:46.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55342024-11-19T02:20:46.124ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
55352024-11-19T02:20:46.124ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55362024-11-19T02:20:46.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55372024-11-19T02:20:46.128ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55382024-11-19T02:20:46.129ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1543, tv_nsec: 913695439 } })
55392024-11-19T02:20:46.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55402024-11-19T02:20:46.129ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
55412024-11-19T02:20:46.138ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31708 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 5925be0c-8277-47cd-81ea-5828949435b4 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
55422024-11-19T02:20:46.143ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55432024-11-19T02:20:46.150ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
55442024-11-19T02:20:46.150ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
55452024-11-19T02:20:46.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
55462024-11-19T02:20:46.172ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 446.56111ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
55472024-11-19T02:20:46.181ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
55482024-11-19T02:20:46.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
55492024-11-19T02:20:46.191ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
55502024-11-19T02:20:46.193ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
55512024-11-19T02:20:46.194ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55522024-11-19T02:20:46.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
55532024-11-19T02:20:46.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55542024-11-19T02:20:46.197ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55552024-11-19T02:20:46.201ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
55562024-11-19T02:20:46.201ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
55572024-11-19T02:20:46.201ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55582024-11-19T02:20:46.201ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2158261-df40-4930-a016-befc03dd1ae6", "content-length": "1", "date": "Tue, 19 Nov 2024 02:20:45 GMT"} })
55592024-11-19T02:20:46.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55602024-11-19T02:20:46.202ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 477.0907ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
55612024-11-19T02:20:46.203ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55622024-11-19T02:20:46.203ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 477.459194ms iteration = 23 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
55632024-11-19T02:20:46.204ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
55642024-11-19T02:20:46.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
55652024-11-19T02:20:46.205ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55662024-11-19T02:20:46.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55672024-11-19T02:20:46.207ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
55682024-11-19T02:20:46.207ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55692024-11-19T02:20:46.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55702024-11-19T02:20:46.209ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
55712024-11-19T02:20:46.209ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 8c04fa4d-031f-4603-9b0e-246b45d39276 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
55722024-11-19T02:20:46.209ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
55732024-11-19T02:20:46.210ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
55742024-11-19T02:20:46.210ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
55752024-11-19T02:20:46.210ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 484.515586ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
55762024-11-19T02:20:46.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
55772024-11-19T02:20:46.211ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 486.216055ms iteration = 23 status = null
55782024-11-19T02:20:46.212ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55792024-11-19T02:20:46.216ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 zone_address = fd00:1122:3344:101::2
55802024-11-19T02:20:46.216ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55812024-11-19T02:20:46.216ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd73a8b2-0f03-49fa-993e-901bbb480c4c", "content-length": "26", "date": "Tue, 19 Nov 2024 02:20:45 GMT"} })
55822024-11-19T02:20:46.216ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55832024-11-19T02:20:46.217ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
55842024-11-19T02:20:46.217ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
55852024-11-19T02:20:46.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
55862024-11-19T02:20:46.220ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
55872024-11-19T02:20:46.220ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 8c04fa4d-031f-4603-9b0e-246b45d39276 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
55882024-11-19T02:20:46.220ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
55892024-11-19T02:20:46.220ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-19 02:10:27.714570 UTC dns_group = internal generation = 1
55902024-11-19T02:20:46.220ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 495.960416ms iteration = 13 status = {"generation":1}
55912024-11-19T02:20:46.237ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
55922024-11-19T02:20:46.237ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 511.892078ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
55932024-11-19T02:20:46.246ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 520.968663ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
55942024-11-19T02:20:46.248ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55952024-11-19T02:20:46.248ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
55962024-11-19T02:20:46.248ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
55972024-11-19T02:20:46.248ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "8ba04046-2aa2-417d-8d9e-be777f1fafe0", "date": "Tue, 19 Nov 2024 02:20:46 GMT"} })
55982024-11-19T02:20:46.248ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55992024-11-19T02:20:46.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56002024-11-19T02:20:46.251ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
56012024-11-19T02:20:46.251ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
56022024-11-19T02:20:46.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
56032024-11-19T02:20:46.253ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56042024-11-19T02:20:46.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56052024-11-19T02:20:46.254ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
56062024-11-19T02:20:46.254ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = af79c7eb-bc4d-42f8-9217-8b35affeeebb dns_zone_name = oxide.test found_so_far = 0 version = 2
56072024-11-19T02:20:46.254ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
56082024-11-19T02:20:46.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
56092024-11-19T02:20:46.256ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56102024-11-19T02:20:46.256ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56112024-11-19T02:20:46.257ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56122024-11-19T02:20:46.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56132024-11-19T02:20:46.260ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: ffe74824-0c08-48e1-a755-fb123e8dc181, lookup_type: ById(ffe74824-0c08-48e1-a755-fb123e8dc181) } result = Ok(())
56142024-11-19T02:20:46.260ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56152024-11-19T02:20:46.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56162024-11-19T02:20:46.261ZINFOnexus (BackgroundTasks): VPC route manager sled ffe74824-0c08-48e1-a755-fb123e8dc181 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
56172024-11-19T02:20:46.261ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
56182024-11-19T02:20:46.261ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
56192024-11-19T02:20:46.261ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
56202024-11-19T02:20:46.261ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1bc7df5b-190c-490a-8108-a5549ec494a7", "date": "Tue, 19 Nov 2024 02:20:46 GMT"} })
56212024-11-19T02:20:46.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
56222024-11-19T02:20:46.263ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 537.613743ms iteration = 23 status = 0
56232024-11-19T02:20:46.263ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 537.962727ms iteration = 24 status = {}
56242024-11-19T02:20:46.269ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = af79c7eb-bc4d-42f8-9217-8b35affeeebb dns_zone_name = oxide.test found_so_far = 1 version = 2
56252024-11-19T02:20:46.272ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
56262024-11-19T02:20:46.273ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-19 02:10:28.769117 UTC dns_group = external generation = 2
56272024-11-19T02:20:46.273ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 548.104153ms iteration = 13 status = {"generation":2}
56282024-11-19T02:20:46.273ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
56292024-11-19T02:20:46.274ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "65777f32-b7d5-4391-9344-fe87458ccadd", "date": "Tue, 19 Nov 2024 02:20:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
56302024-11-19T02:20:46.274ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
56312024-11-19T02:20:46.276ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "7dd010ea-2f93-4506-9292-32900b3e0a00", "date": "Tue, 19 Nov 2024 02:20:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
56322024-11-19T02:20:46.276ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
56332024-11-19T02:20:46.278ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "e1ef52c1-44f5-40f4-b409-f32ab5023c42", "date": "Tue, 19 Nov 2024 02:20:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
56342024-11-19T02:20:46.278ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
56352024-11-19T02:20:46.281ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
56362024-11-19T02:20:46.281ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 556.865403ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
56372024-11-19T02:20:46.302ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
56382024-11-19T02:20:46.302ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 576.455438ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
56392024-11-19T02:20:46.304ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-19T02:09:41.910054Z, time_modified: 2024-11-19T02:09:41.910054Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 78638afa-e975-44a9-b764-0afec18d156f, db_silo: Silo { identity: SiloIdentity { id: 78638afa-e975-44a9-b764-0afec18d156f, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-19T02:10:28.623188Z, time_modified: 2024-11-19T02:10:28.623188Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "fe94815f3f5502a309deafc95cd58d4fe61e984b7bd8ad11309589068beb64f5" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 78638afa-e975-44a9-b764-0afec18d156f, db_silo: Silo { identity: SiloIdentity { id: 78638afa-e975-44a9-b764-0afec18d156f, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-19T02:10:28.623188Z, time_modified: 2024-11-19T02:10:28.623188Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "fe94815f3f5502a309deafc95cd58d4fe61e984b7bd8ad11309589068beb64f5" }] }) }
56402024-11-19T02:20:46.305ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 580.230831ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"78638afa-e975-44a9-b764-0afec18d156f","tls_certs":["fe94815f3f5502a309deafc95cd58d4fe61e984b7bd8ad11309589068beb64f5"]}},"default_endpoint":{"silo_id":"78638afa-e975-44a9-b764-0afec18d156f","tls_certs":["fe94815f3f5502a309deafc95cd58d4fe61e984b7bd8ad11309589068beb64f5"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
56412024-11-19T02:20:46.308ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56422024-11-19T02:20:46.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56432024-11-19T02:20:46.310ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 585.378459ms iteration = 27 status = {"physical_disks_added":0}
56442024-11-19T02:20:46.349ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56452024-11-19T02:20:46.351ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
56462024-11-19T02:20:46.351ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56472024-11-19T02:20:46.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56482024-11-19T02:20:46.357ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56492024-11-19T02:20:46.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56502024-11-19T02:20:46.359ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 20bc3881-e2ee-4d8d-b84b-b0c1e478721f, rack_id: a894e92e-d765-4f15-b6b7-cb9ca46d1860, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8597d802-6d4d-4493-88de-333a1f340c20) } rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0
56512024-11-19T02:20:46.359ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56522024-11-19T02:20:46.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56532024-11-19T02:20:46.370ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
56542024-11-19T02:20:46.370ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e6c8bf3-e1a9-4b8e-8241-13c67e0b1ae6", "content-length": "134", "date": "Tue, 19 Nov 2024 02:20:45 GMT"} })
56552024-11-19T02:20:46.370ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
56562024-11-19T02:20:46.370ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8597d802-6d4d-4493-88de-333a1f340c20
56572024-11-19T02:20:46.371ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
56582024-11-19T02:20:46.371ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
56592024-11-19T02:20:46.371ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56602024-11-19T02:20:46.371ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56612024-11-19T02:20:46.371ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56622024-11-19T02:20:46.371ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
56632024-11-19T02:20:46.371ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56642024-11-19T02:20:46.371ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
56652024-11-19T02:20:46.371ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
56662024-11-19T02:20:46.371ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56672024-11-19T02:20:46.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56682024-11-19T02:20:46.373ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
56692024-11-19T02:20:46.373ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "f9553a9c-c5ee-40a7-9ce2-2bd544a09b4d", "content-length": "2", "date": "Tue, 19 Nov 2024 02:20:45 GMT"} })
56702024-11-19T02:20:46.373ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
56712024-11-19T02:20:46.374ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "8d933707-7ad7-43f9-916c-941f30d50c04", "content-length": "52", "date": "Tue, 19 Nov 2024 02:20:45 GMT"} })
56722024-11-19T02:20:46.374ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0
56732024-11-19T02:20:46.374ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
56742024-11-19T02:20:46.386ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56752024-11-19T02:20:46.388ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
56762024-11-19T02:20:46.388ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56772024-11-19T02:20:46.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56782024-11-19T02:20:46.479ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
56792024-11-19T02:20:46.485ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f170e3bb-cc22-4006-8d29-81c9ab9ad0db", "date": "Tue, 19 Nov 2024 02:20:46 GMT"} })
56802024-11-19T02:20:46.485ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch = Switch0
56812024-11-19T02:20:46.485ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
56822024-11-19T02:20:46.486ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d0bec252-3d0d-46b3-a898-e4097efd3bda", "content-length": "691", "date": "Tue, 19 Nov 2024 02:20:46 GMT"} })
56832024-11-19T02:20:46.486ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
56842024-11-19T02:20:46.486ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
56852024-11-19T02:20:46.486ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
56862024-11-19T02:20:46.486ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0234fc90-a790-4cb0-88da-ee3352a2b57f", "content-length": "682", "date": "Tue, 19 Nov 2024 02:20:46 GMT"} })
56872024-11-19T02:20:46.486ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56882024-11-19T02:20:46.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56892024-11-19T02:20:46.488ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 762.861372ms iteration = 23 status = {}
56902024-11-19T02:20:46.490ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56912024-11-19T02:20:46.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56922024-11-19T02:20:46.494ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56932024-11-19T02:20:46.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56942024-11-19T02:20:46.496ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56952024-11-19T02:20:46.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56962024-11-19T02:20:46.503ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 778.203666ms iteration = 23 status = {}
56972024-11-19T02:20:47.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = c351ed51-f2b7-4b9b-b7b8-db8326c51561 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
56982024-11-19T02:20:47.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = c351ed51-f2b7-4b9b-b7b8-db8326c51561 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
56992024-11-19T02:20:47.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3523 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = c351ed51-f2b7-4b9b-b7b8-db8326c51561 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
57002024-11-19T02:20:47.173ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 51b3e295-dc9c-4aa6-b129-0ada2571d05c roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
57012024-11-19T02:20:47.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 51b3e295-dc9c-4aa6-b129-0ada2571d05c resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
57022024-11-19T02:20:47.175ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1988 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 51b3e295-dc9c-4aa6-b129-0ada2571d05c response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
57032024-11-19T02:20:48.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6b8927d8-1e44-4ff9-acf5-21255dc1ebfa roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
57042024-11-19T02:20:48.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6b8927d8-1e44-4ff9-acf5-21255dc1ebfa resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
57052024-11-19T02:20:48.200ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2248 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6b8927d8-1e44-4ff9-acf5-21255dc1ebfa response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
57062024-11-19T02:20:49.223ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 17459ba6-0756-4722-9aed-10dc95bfc30d roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
57072024-11-19T02:20:49.223ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 17459ba6-0756-4722-9aed-10dc95bfc30d resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
57082024-11-19T02:20:49.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2755 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 17459ba6-0756-4722-9aed-10dc95bfc30d response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
57092024-11-19T02:20:50.249ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 26a0b8cf-1581-4da3-b5bd-f23abec00a27 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
57102024-11-19T02:20:50.249ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 26a0b8cf-1581-4da3-b5bd-f23abec00a27 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
57112024-11-19T02:20:50.251ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2281 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 26a0b8cf-1581-4da3-b5bd-f23abec00a27 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
57122024-11-19T02:20:51.274ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 70ee7392-f56e-42c9-b433-6a7c621c6015 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
57132024-11-19T02:20:51.274ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 70ee7392-f56e-42c9-b433-6a7c621c6015 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
57142024-11-19T02:20:51.277ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2724 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 70ee7392-f56e-42c9-b433-6a7c621c6015 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
57152024-11-19T02:20:52.154ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1469 local_addr = [fd00:1122:3344:101::c]:60807 method = GET remote_addr = [fd00:1122:3344:101::d]:57844 req_id = 98c1e18e-be12-4c34-a745-8f696ef54ad2 response_code = 200 uri = /9f0b435f-0000-451e-9dbc-dcec71543c30
57162024-11-19T02:20:52.300ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 06a73a5c-34ad-4fb0-9c7e-1cb638d68cea roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
57172024-11-19T02:20:52.300ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 06a73a5c-34ad-4fb0-9c7e-1cb638d68cea resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
57182024-11-19T02:20:52.301ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1926 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 06a73a5c-34ad-4fb0-9c7e-1cb638d68cea response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
57192024-11-19T02:20:53.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 12f21fc7-c771-45cb-a01c-3b5951a89740 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
57202024-11-19T02:20:53.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 12f21fc7-c771-45cb-a01c-3b5951a89740 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
57212024-11-19T02:20:53.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2273 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 12f21fc7-c771-45cb-a01c-3b5951a89740 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
57222024-11-19T02:20:54.348ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = fb4eba4d-36c5-4aab-8621-bae119c2f98d roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
57232024-11-19T02:20:54.348ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = fb4eba4d-36c5-4aab-8621-bae119c2f98d resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
57242024-11-19T02:20:54.350ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2008 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = fb4eba4d-36c5-4aab-8621-bae119c2f98d response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
57252024-11-19T02:20:55.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4799d7fd-bb80-4b97-8800-f3429f7c8d88 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
57262024-11-19T02:20:55.373ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4799d7fd-bb80-4b97-8800-f3429f7c8d88 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
57272024-11-19T02:20:55.375ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2428 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4799d7fd-bb80-4b97-8800-f3429f7c8d88 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
57282024-11-19T02:20:55.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
57292024-11-19T02:20:55.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57302024-11-19T02:20:55.726ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
57312024-11-19T02:20:55.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57322024-11-19T02:20:55.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57332024-11-19T02:20:55.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57342024-11-19T02:20:55.755ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57352024-11-19T02:20:55.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57362024-11-19T02:20:55.757ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57372024-11-19T02:20:55.759ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
57382024-11-19T02:20:55.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57392024-11-19T02:20:55.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57402024-11-19T02:20:55.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57412024-11-19T02:20:55.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57422024-11-19T02:20:55.763ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57432024-11-19T02:20:55.766ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
57442024-11-19T02:20:55.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57452024-11-19T02:20:55.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57462024-11-19T02:20:55.781ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
57472024-11-19T02:20:55.781ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 55.167981ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
57482024-11-19T02:20:55.788ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.497416ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57492024-11-19T02:20:56.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c7bc1b54-3db5-41e6-a03a-235d39f3dd2c roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
57502024-11-19T02:20:56.397ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c7bc1b54-3db5-41e6-a03a-235d39f3dd2c resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
57512024-11-19T02:20:56.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1845 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c7bc1b54-3db5-41e6-a03a-235d39f3dd2c response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
57522024-11-19T02:20:57.421ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 48d5be4f-6232-4bc4-9e4e-e993459ea56e roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
57532024-11-19T02:20:57.421ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 48d5be4f-6232-4bc4-9e4e-e993459ea56e resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
57542024-11-19T02:20:57.423ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2589 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 48d5be4f-6232-4bc4-9e4e-e993459ea56e response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
57552024-11-19T02:20:58.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 07011eac-3d19-4ff4-a607-c69c4dd744fc roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
57562024-11-19T02:20:58.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 07011eac-3d19-4ff4-a607-c69c4dd744fc resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
57572024-11-19T02:20:58.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2445 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 07011eac-3d19-4ff4-a607-c69c4dd744fc response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
57582024-11-19T02:20:59.470ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3588e2f9-e3e2-4be0-adcb-1b02d6acd7f9 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
57592024-11-19T02:20:59.470ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3588e2f9-e3e2-4be0-adcb-1b02d6acd7f9 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
57602024-11-19T02:20:59.472ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2208 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3588e2f9-e3e2-4be0-adcb-1b02d6acd7f9 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
57612024-11-19T02:21:00.492ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 76cc8ee0-9bee-49c9-969e-a7cc2c3fe36f roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
57622024-11-19T02:21:00.493ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 76cc8ee0-9bee-49c9-969e-a7cc2c3fe36f resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
57632024-11-19T02:21:00.495ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2385 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 76cc8ee0-9bee-49c9-969e-a7cc2c3fe36f response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
57642024-11-19T02:21:01.516ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4bd20035-e852-464b-873a-3668481f6e16 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
57652024-11-19T02:21:01.516ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4bd20035-e852-464b-873a-3668481f6e16 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
57662024-11-19T02:21:01.518ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2012 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4bd20035-e852-464b-873a-3668481f6e16 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
57672024-11-19T02:21:02.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 02a16dc7-3ad6-4c35-87dc-e210d7773c37 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
57682024-11-19T02:21:02.541ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 02a16dc7-3ad6-4c35-87dc-e210d7773c37 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
57692024-11-19T02:21:02.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1961 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 02a16dc7-3ad6-4c35-87dc-e210d7773c37 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
57702024-11-19T02:21:03.564ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b6265ad2-5704-4823-ba41-8beed37c7912 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
57712024-11-19T02:21:03.564ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b6265ad2-5704-4823-ba41-8beed37c7912 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
57722024-11-19T02:21:03.566ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2030 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b6265ad2-5704-4823-ba41-8beed37c7912 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
57732024-11-19T02:21:04.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6ee69136-2d31-4960-8a01-356bc4d80127 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
57742024-11-19T02:21:04.588ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6ee69136-2d31-4960-8a01-356bc4d80127 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
57752024-11-19T02:21:04.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2272 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6ee69136-2d31-4960-8a01-356bc4d80127 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
57762024-11-19T02:21:05.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = f167b70a-f475-419e-8413-19c259e95b6f roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
57772024-11-19T02:21:05.611ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = f167b70a-f475-419e-8413-19c259e95b6f resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
57782024-11-19T02:21:05.613ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2540 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = f167b70a-f475-419e-8413-19c259e95b6f response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
57792024-11-19T02:21:05.725ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
57802024-11-19T02:21:05.725ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
57812024-11-19T02:21:05.725ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57822024-11-19T02:21:05.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57832024-11-19T02:21:05.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57842024-11-19T02:21:05.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57852024-11-19T02:21:05.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57862024-11-19T02:21:05.730ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
57872024-11-19T02:21:05.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57882024-11-19T02:21:05.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57892024-11-19T02:21:05.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57902024-11-19T02:21:05.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57912024-11-19T02:21:05.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57922024-11-19T02:21:05.736ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
57932024-11-19T02:21:05.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57942024-11-19T02:21:05.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57952024-11-19T02:21:05.745ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
57962024-11-19T02:21:05.746ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.10256ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
57972024-11-19T02:21:05.756ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57982024-11-19T02:21:05.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57992024-11-19T02:21:05.785ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.896735ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
58002024-11-19T02:21:06.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 95192a8f-f189-4aca-a095-b3a2611b29f7 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
58012024-11-19T02:21:06.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 95192a8f-f189-4aca-a095-b3a2611b29f7 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
58022024-11-19T02:21:06.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1964 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 95192a8f-f189-4aca-a095-b3a2611b29f7 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
58032024-11-19T02:21:07.154ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1429 local_addr = [fd00:1122:3344:101::c]:60807 method = GET remote_addr = [fd00:1122:3344:101::d]:57844 req_id = edb76658-a4b7-4f43-83fc-57f1ef4d6c72 response_code = 200 uri = /9f0b435f-0000-451e-9dbc-dcec71543c30
58042024-11-19T02:21:07.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 37a323c1-9882-4d13-a7c6-0df9d11c4128 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
58052024-11-19T02:21:07.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 37a323c1-9882-4d13-a7c6-0df9d11c4128 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
58062024-11-19T02:21:07.662ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2279 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 37a323c1-9882-4d13-a7c6-0df9d11c4128 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
58072024-11-19T02:21:08.684ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3d412e58-e5d0-4d6c-a21b-b22c15686bfb roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
58082024-11-19T02:21:08.684ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3d412e58-e5d0-4d6c-a21b-b22c15686bfb resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
58092024-11-19T02:21:08.686ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2280 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3d412e58-e5d0-4d6c-a21b-b22c15686bfb response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
58102024-11-19T02:21:09.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ab2de479-8050-4c67-95fd-cbcea21324b8 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
58112024-11-19T02:21:09.708ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ab2de479-8050-4c67-95fd-cbcea21324b8 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
58122024-11-19T02:21:09.710ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2350 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ab2de479-8050-4c67-95fd-cbcea21324b8 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
58132024-11-19T02:21:10.733ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 68d3a453-d3a8-4be6-9573-1fa54e8e3e97 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
58142024-11-19T02:21:10.733ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 68d3a453-d3a8-4be6-9573-1fa54e8e3e97 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
58152024-11-19T02:21:10.735ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1923 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 68d3a453-d3a8-4be6-9573-1fa54e8e3e97 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
58162024-11-19T02:21:11.761ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6226d911-8d0f-4aab-813d-4f1c27b20a24 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
58172024-11-19T02:21:11.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6226d911-8d0f-4aab-813d-4f1c27b20a24 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
58182024-11-19T02:21:11.763ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2173 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6226d911-8d0f-4aab-813d-4f1c27b20a24 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
58192024-11-19T02:21:12.784ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ee49b49d-e411-4939-9e7c-cf9098c1328a roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
58202024-11-19T02:21:12.785ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ee49b49d-e411-4939-9e7c-cf9098c1328a resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
58212024-11-19T02:21:12.787ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2179 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ee49b49d-e411-4939-9e7c-cf9098c1328a response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
58222024-11-19T02:21:13.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 38e641ff-c6b6-4e05-bb13-984d97d4fdc6 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
58232024-11-19T02:21:13.810ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 38e641ff-c6b6-4e05-bb13-984d97d4fdc6 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
58242024-11-19T02:21:13.812ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2530 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 38e641ff-c6b6-4e05-bb13-984d97d4fdc6 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
58252024-11-19T02:21:14.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a3eb7d47-87d7-43cd-8e6a-c376ba737f8a roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
58262024-11-19T02:21:14.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a3eb7d47-87d7-43cd-8e6a-c376ba737f8a resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
58272024-11-19T02:21:14.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1829 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a3eb7d47-87d7-43cd-8e6a-c376ba737f8a response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
58282024-11-19T02:21:15.725ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
58292024-11-19T02:21:15.725ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
58302024-11-19T02:21:15.725ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
58312024-11-19T02:21:15.725ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
58322024-11-19T02:21:15.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
58332024-11-19T02:21:15.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
58342024-11-19T02:21:15.725ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
58352024-11-19T02:21:15.725ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
58362024-11-19T02:21:15.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
58372024-11-19T02:21:15.725ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
58382024-11-19T02:21:15.725ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
58392024-11-19T02:21:15.725ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
58402024-11-19T02:21:15.725ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58412024-11-19T02:21:15.725ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
58422024-11-19T02:21:15.725ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
58432024-11-19T02:21:15.725ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
58442024-11-19T02:21:15.725ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
58452024-11-19T02:21:15.725ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
58462024-11-19T02:21:15.726ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
58472024-11-19T02:21:15.726ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58482024-11-19T02:21:15.726ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
58492024-11-19T02:21:15.726ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58502024-11-19T02:21:15.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58512024-11-19T02:21:15.726ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
58522024-11-19T02:21:15.726ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
58532024-11-19T02:21:15.726ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
58542024-11-19T02:21:15.726ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58552024-11-19T02:21:15.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
58562024-11-19T02:21:15.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
58572024-11-19T02:21:15.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
58582024-11-19T02:21:15.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58592024-11-19T02:21:15.726ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
58602024-11-19T02:21:15.726ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58612024-11-19T02:21:15.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
58622024-11-19T02:21:15.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
58632024-11-19T02:21:15.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
58642024-11-19T02:21:15.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
58652024-11-19T02:21:15.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
58662024-11-19T02:21:15.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
58672024-11-19T02:21:15.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
58682024-11-19T02:21:15.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58692024-11-19T02:21:15.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58702024-11-19T02:21:15.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
58712024-11-19T02:21:15.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58722024-11-19T02:21:15.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58732024-11-19T02:21:15.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58742024-11-19T02:21:15.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
58752024-11-19T02:21:15.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
58762024-11-19T02:21:15.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
58772024-11-19T02:21:15.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58782024-11-19T02:21:15.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58792024-11-19T02:21:15.728ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1573, tv_nsec: 511834000 } })
58802024-11-19T02:21:15.728ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1573, tv_nsec: 512129603 } })
58812024-11-19T02:21:15.728ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
58822024-11-19T02:21:15.728ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
58832024-11-19T02:21:15.730ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58842024-11-19T02:21:15.730ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.297699ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
58852024-11-19T02:21:15.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58862024-11-19T02:21:15.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
58872024-11-19T02:21:15.732ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58882024-11-19T02:21:15.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58892024-11-19T02:21:15.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
58902024-11-19T02:21:15.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58912024-11-19T02:21:15.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58922024-11-19T02:21:15.735ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58932024-11-19T02:21:15.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58942024-11-19T02:21:15.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58952024-11-19T02:21:15.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58962024-11-19T02:21:15.737ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1573, tv_nsec: 521502480 } })
58972024-11-19T02:21:15.737ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
58982024-11-19T02:21:15.764ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
58992024-11-19T02:21:15.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
59002024-11-19T02:21:15.766ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
59012024-11-19T02:21:15.766ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
59022024-11-19T02:21:15.766ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
59032024-11-19T02:21:15.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
59042024-11-19T02:21:15.770ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
59052024-11-19T02:21:15.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
59062024-11-19T02:21:15.773ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 47.495184ms iteration = 24 status = {"errors":[],"records_set_to_done":[]}
59072024-11-19T02:21:15.773ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59082024-11-19T02:21:15.775ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59092024-11-19T02:21:15.776ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
59102024-11-19T02:21:15.776ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59112024-11-19T02:21:15.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59122024-11-19T02:21:15.776ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59132024-11-19T02:21:15.778ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 52.870145ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
59142024-11-19T02:21:15.779ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
59152024-11-19T02:21:15.779ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59162024-11-19T02:21:15.779ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59172024-11-19T02:21:15.779ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
59182024-11-19T02:21:15.779ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59192024-11-19T02:21:15.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
59202024-11-19T02:21:15.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59212024-11-19T02:21:15.780ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
59222024-11-19T02:21:15.780ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59232024-11-19T02:21:15.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59242024-11-19T02:21:15.781ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59252024-11-19T02:21:15.782ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
59262024-11-19T02:21:15.782ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
59272024-11-19T02:21:15.782ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
59282024-11-19T02:21:15.782ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59292024-11-19T02:21:15.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
59302024-11-19T02:21:15.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59312024-11-19T02:21:15.783ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59322024-11-19T02:21:15.783ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 57.533229ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
59332024-11-19T02:21:15.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59342024-11-19T02:21:15.783ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
59352024-11-19T02:21:15.783ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59362024-11-19T02:21:15.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59372024-11-19T02:21:15.785ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59382024-11-19T02:21:15.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59392024-11-19T02:21:15.785ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59402024-11-19T02:21:15.787ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
59412024-11-19T02:21:15.787ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59422024-11-19T02:21:15.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59432024-11-19T02:21:15.796ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
59442024-11-19T02:21:15.796ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 70.624828ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
59452024-11-19T02:21:15.802ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
59462024-11-19T02:21:15.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
59472024-11-19T02:21:15.803ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
59482024-11-19T02:21:15.803ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
59492024-11-19T02:21:15.803ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
59502024-11-19T02:21:15.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
59512024-11-19T02:21:15.810ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59522024-11-19T02:21:15.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59532024-11-19T02:21:15.813ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59542024-11-19T02:21:15.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59552024-11-19T02:21:15.814ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59562024-11-19T02:21:15.816ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 90.90219ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
59572024-11-19T02:21:15.819ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: ffe74824-0c08-48e1-a755-fb123e8dc181, lookup_type: ById(ffe74824-0c08-48e1-a755-fb123e8dc181) } result = Ok(())
59582024-11-19T02:21:15.819ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59592024-11-19T02:21:15.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59602024-11-19T02:21:15.821ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 95.24357ms iteration = 24 status = 0
59612024-11-19T02:21:15.822ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
59622024-11-19T02:21:15.822ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 96.541235ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
59632024-11-19T02:21:15.823ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 97.232653ms iteration = 24 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
59642024-11-19T02:21:15.825ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
59652024-11-19T02:21:15.825ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59662024-11-19T02:21:15.826ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ed08954-df65-4ae4-b993-bcf128311fad", "content-length": "26", "date": "Tue, 19 Nov 2024 02:21:15 GMT"} })
59672024-11-19T02:21:15.826ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59682024-11-19T02:21:15.828ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
59692024-11-19T02:21:15.831ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 105.991734ms iteration = 28 status = {"physical_disks_added":0}
59702024-11-19T02:21:15.837ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
59712024-11-19T02:21:15.837ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59722024-11-19T02:21:15.837ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 111.601978ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
59732024-11-19T02:21:15.837ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "038c99bc-b93b-472c-8446-42d548de4dab", "content-length": "26", "date": "Tue, 19 Nov 2024 02:21:15 GMT"} })
59742024-11-19T02:21:15.837ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59752024-11-19T02:21:15.838ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
59762024-11-19T02:21:15.838ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
59772024-11-19T02:21:15.838ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 112.6592ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
59782024-11-19T02:21:15.840ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
59792024-11-19T02:21:15.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 7c839817-f1b4-4024-8667-5bf8d0a21e56 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
59802024-11-19T02:21:15.858ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 7c839817-f1b4-4024-8667-5bf8d0a21e56 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
59812024-11-19T02:21:15.859ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59822024-11-19T02:21:15.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59832024-11-19T02:21:15.859ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2169 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 7c839817-f1b4-4024-8667-5bf8d0a21e56 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
59842024-11-19T02:21:15.875ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 zone_address = fd00:1122:3344:101::2
59852024-11-19T02:21:15.875ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59862024-11-19T02:21:15.875ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "278c49a7-698f-4d82-935a-e3f750b634bf", "content-length": "26", "date": "Tue, 19 Nov 2024 02:21:15 GMT"} })
59872024-11-19T02:21:15.875ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59882024-11-19T02:21:15.877ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
59892024-11-19T02:21:15.980ZINFOnexus (BackgroundTasks): VPC route manager sled ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
59902024-11-19T02:21:15.980ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
59912024-11-19T02:21:15.981ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "afdb26a1-c659-4173-9fee-4f014ad341ca", "content-length": "372", "date": "Tue, 19 Nov 2024 02:21:15 GMT"} })
59922024-11-19T02:21:15.981ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59932024-11-19T02:21:15.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59942024-11-19T02:21:15.998ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59952024-11-19T02:21:15.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59962024-11-19T02:21:16.000ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59972024-11-19T02:21:16.002ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
59982024-11-19T02:21:16.002ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59992024-11-19T02:21:16.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60002024-11-19T02:21:16.004ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60012024-11-19T02:21:16.006ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
60022024-11-19T02:21:16.006ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60032024-11-19T02:21:16.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60042024-11-19T02:21:16.035ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
60052024-11-19T02:21:16.035ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
60062024-11-19T02:21:16.035ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6bea2479-342c-4586-b5b3-29adbab8e35a", "date": "Tue, 19 Nov 2024 02:21:15 GMT"} })
60072024-11-19T02:21:16.035ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60082024-11-19T02:21:16.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60092024-11-19T02:21:16.039ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60102024-11-19T02:21:16.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60112024-11-19T02:21:16.043ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60122024-11-19T02:21:16.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60132024-11-19T02:21:16.051ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
60142024-11-19T02:21:16.052ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "74e4ec49-f888-42a8-974c-409c428d8c17", "content-length": "1", "date": "Tue, 19 Nov 2024 02:21:15 GMT"} })
60152024-11-19T02:21:16.052ZINFOnexus (BackgroundTasks): VPC route manager sled ffe74824-0c08-48e1-a755-fb123e8dc181 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
60162024-11-19T02:21:16.052ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
60172024-11-19T02:21:16.052ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "79b5fa1a-3a90-4580-83da-571b49b3237f", "date": "Tue, 19 Nov 2024 02:21:15 GMT"} })
60182024-11-19T02:21:16.054ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
60192024-11-19T02:21:16.054ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 328.705672ms iteration = 25 status = {}
60202024-11-19T02:21:16.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
60212024-11-19T02:21:16.056ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 331.870449ms iteration = 24 status = null
60222024-11-19T02:21:16.059ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 334.053184ms iteration = 24 status = {}
60232024-11-19T02:21:16.136ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60242024-11-19T02:21:16.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60252024-11-19T02:21:16.137ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
60262024-11-19T02:21:16.137ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f6a786ab-dd08-47bb-ab26-077778045123", "content-length": "691", "date": "Tue, 19 Nov 2024 02:21:15 GMT"} })
60272024-11-19T02:21:16.137ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
60282024-11-19T02:21:16.137ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
60292024-11-19T02:21:16.137ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
60302024-11-19T02:21:16.138ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 20bc3881-e2ee-4d8d-b84b-b0c1e478721f, rack_id: a894e92e-d765-4f15-b6b7-cb9ca46d1860, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8597d802-6d4d-4493-88de-333a1f340c20) } rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0
60312024-11-19T02:21:16.138ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60322024-11-19T02:21:16.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60332024-11-19T02:21:16.140ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 414.18678ms iteration = 24 status = {}
60342024-11-19T02:21:16.155ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
60352024-11-19T02:21:16.155ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "f40d0895-4b19-4e1f-98d8-e5ccb0a68bec", "content-length": "134", "date": "Tue, 19 Nov 2024 02:21:15 GMT"} })
60362024-11-19T02:21:16.155ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
60372024-11-19T02:21:16.155ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8597d802-6d4d-4493-88de-333a1f340c20
60382024-11-19T02:21:16.156ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
60392024-11-19T02:21:16.156ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
60402024-11-19T02:21:16.156ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60412024-11-19T02:21:16.156ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60422024-11-19T02:21:16.156ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60432024-11-19T02:21:16.156ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
60442024-11-19T02:21:16.156ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60452024-11-19T02:21:16.156ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
60462024-11-19T02:21:16.156ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
60472024-11-19T02:21:16.156ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60482024-11-19T02:21:16.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60492024-11-19T02:21:16.158ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
60502024-11-19T02:21:16.159ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "61b74d30-5e7f-41c3-bb85-5756a8db3098", "content-length": "2", "date": "Tue, 19 Nov 2024 02:21:15 GMT"} })
60512024-11-19T02:21:16.159ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
60522024-11-19T02:21:16.159ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "2702c3ec-3064-4fc0-a793-e2817ceb2563", "content-length": "52", "date": "Tue, 19 Nov 2024 02:21:15 GMT"} })
60532024-11-19T02:21:16.159ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0
60542024-11-19T02:21:16.159ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
60552024-11-19T02:21:16.278ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "796c5a0b-7f38-449d-be26-9c95bdf3c40b", "date": "Tue, 19 Nov 2024 02:21:15 GMT"} })
60562024-11-19T02:21:16.278ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch = Switch0
60572024-11-19T02:21:16.278ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
60582024-11-19T02:21:16.279ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "82901166-b349-4a17-9ca8-b5278c43d515", "content-length": "682", "date": "Tue, 19 Nov 2024 02:21:16 GMT"} })
60592024-11-19T02:21:16.279ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60602024-11-19T02:21:16.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60612024-11-19T02:21:16.283ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60622024-11-19T02:21:16.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60632024-11-19T02:21:16.287ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60642024-11-19T02:21:16.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60652024-11-19T02:21:16.289ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60662024-11-19T02:21:16.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60672024-11-19T02:21:16.297ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 571.635063ms iteration = 24 status = {}
60682024-11-19T02:21:16.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e3268e9a-df8c-40be-bd6e-1b7d6ea080c5 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
60692024-11-19T02:21:16.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e3268e9a-df8c-40be-bd6e-1b7d6ea080c5 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
60702024-11-19T02:21:16.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2172 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e3268e9a-df8c-40be-bd6e-1b7d6ea080c5 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
60712024-11-19T02:21:17.080ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = 48c88023-2086-45b3-8166-e3ca6f988e0e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
60722024-11-19T02:21:17.080ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = 48c88023-2086-45b3-8166-e3ca6f988e0e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
60732024-11-19T02:21:17.083ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3053 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = 48c88023-2086-45b3-8166-e3ca6f988e0e response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
60742024-11-19T02:21:17.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a79e1543-9035-4c04-a73d-9d5029521615 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
60752024-11-19T02:21:17.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a79e1543-9035-4c04-a73d-9d5029521615 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
60762024-11-19T02:21:17.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2341 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a79e1543-9035-4c04-a73d-9d5029521615 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
60772024-11-19T02:21:18.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e9b68807-b0a5-4a15-9860-74c8429199ce roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
60782024-11-19T02:21:18.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e9b68807-b0a5-4a15-9860-74c8429199ce resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
60792024-11-19T02:21:18.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2268 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e9b68807-b0a5-4a15-9860-74c8429199ce response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
60802024-11-19T02:21:19.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 571bb23c-3944-4d58-be60-c688a5d5f9bc roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
60812024-11-19T02:21:19.961ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 571bb23c-3944-4d58-be60-c688a5d5f9bc resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
60822024-11-19T02:21:19.963ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2197 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 571bb23c-3944-4d58-be60-c688a5d5f9bc response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
60832024-11-19T02:21:20.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 10041377-c4fd-4221-8937-2a41e1eb4adb roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
60842024-11-19T02:21:20.986ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 10041377-c4fd-4221-8937-2a41e1eb4adb resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
60852024-11-19T02:21:20.987ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1978 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 10041377-c4fd-4221-8937-2a41e1eb4adb response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
60862024-11-19T02:21:22.013ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d9eae96f-ad98-49a4-a2e9-ca99150ddaba roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
60872024-11-19T02:21:22.014ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d9eae96f-ad98-49a4-a2e9-ca99150ddaba resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
60882024-11-19T02:21:22.015ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1827 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d9eae96f-ad98-49a4-a2e9-ca99150ddaba response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
60892024-11-19T02:21:22.154ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1263 local_addr = [fd00:1122:3344:101::c]:60807 method = GET remote_addr = [fd00:1122:3344:101::d]:57844 req_id = d423749b-f835-4b30-83cf-b2a0e89a256e response_code = 200 uri = /9f0b435f-0000-451e-9dbc-dcec71543c30
60902024-11-19T02:21:23.037ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c52ac7d7-3471-4553-aabd-5d0c2956adbf roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
60912024-11-19T02:21:23.037ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c52ac7d7-3471-4553-aabd-5d0c2956adbf resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
60922024-11-19T02:21:23.039ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2005 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c52ac7d7-3471-4553-aabd-5d0c2956adbf response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
60932024-11-19T02:21:24.061ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 18673411-3d9f-49f3-b4fb-dd64dc7cd39a roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
60942024-11-19T02:21:24.062ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 18673411-3d9f-49f3-b4fb-dd64dc7cd39a resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
60952024-11-19T02:21:24.063ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2426 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 18673411-3d9f-49f3-b4fb-dd64dc7cd39a response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
60962024-11-19T02:21:25.085ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 8dd3aba7-70f3-499e-baf2-42800a0497a9 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
60972024-11-19T02:21:25.086ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 8dd3aba7-70f3-499e-baf2-42800a0497a9 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
60982024-11-19T02:21:25.087ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2000 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 8dd3aba7-70f3-499e-baf2-42800a0497a9 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
60992024-11-19T02:21:25.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
61002024-11-19T02:21:25.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61012024-11-19T02:21:25.726ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
61022024-11-19T02:21:25.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61032024-11-19T02:21:25.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61042024-11-19T02:21:25.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61052024-11-19T02:21:25.728ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61062024-11-19T02:21:25.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61072024-11-19T02:21:25.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61082024-11-19T02:21:25.730ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.839334ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
61092024-11-19T02:21:25.731ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
61102024-11-19T02:21:25.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61112024-11-19T02:21:25.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61122024-11-19T02:21:25.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61132024-11-19T02:21:25.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61142024-11-19T02:21:25.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61152024-11-19T02:21:25.737ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
61162024-11-19T02:21:25.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61172024-11-19T02:21:25.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61182024-11-19T02:21:25.748ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
61192024-11-19T02:21:25.748ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.338046ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
61202024-11-19T02:21:26.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 8ffb6d32-3bb8-4e25-a1d7-a6c592c62d02 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
61212024-11-19T02:21:26.110ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 8ffb6d32-3bb8-4e25-a1d7-a6c592c62d02 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
61222024-11-19T02:21:26.112ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2333 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 8ffb6d32-3bb8-4e25-a1d7-a6c592c62d02 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
61232024-11-19T02:21:27.134ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a0e6a625-7e51-4177-9d5c-e950b42dfda2 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
61242024-11-19T02:21:27.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a0e6a625-7e51-4177-9d5c-e950b42dfda2 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
61252024-11-19T02:21:27.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2328 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a0e6a625-7e51-4177-9d5c-e950b42dfda2 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
61262024-11-19T02:21:28.158ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 957a6cf0-f695-4e71-9a04-b4d453a90960 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
61272024-11-19T02:21:28.158ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 957a6cf0-f695-4e71-9a04-b4d453a90960 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
61282024-11-19T02:21:28.160ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2347 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 957a6cf0-f695-4e71-9a04-b4d453a90960 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
61292024-11-19T02:21:29.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = f34618d4-bbe9-42f8-8aef-6874cdb7a854 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
61302024-11-19T02:21:29.182ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = f34618d4-bbe9-42f8-8aef-6874cdb7a854 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
61312024-11-19T02:21:29.184ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2079 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = f34618d4-bbe9-42f8-8aef-6874cdb7a854 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
61322024-11-19T02:21:30.209ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 19f7f449-fe43-4fb4-9236-19f1eaf7ca6a roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
61332024-11-19T02:21:30.209ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 19f7f449-fe43-4fb4-9236-19f1eaf7ca6a resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
61342024-11-19T02:21:30.211ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2470 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 19f7f449-fe43-4fb4-9236-19f1eaf7ca6a response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
61352024-11-19T02:21:31.233ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 26fbba83-d40f-41a7-8c31-e5115c31a87b roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
61362024-11-19T02:21:31.233ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 26fbba83-d40f-41a7-8c31-e5115c31a87b resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
61372024-11-19T02:21:31.235ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2167 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 26fbba83-d40f-41a7-8c31-e5115c31a87b response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
61382024-11-19T02:21:32.259ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6dae463c-3acc-4add-9be1-bf8cbe67409e roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
61392024-11-19T02:21:32.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6dae463c-3acc-4add-9be1-bf8cbe67409e resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
61402024-11-19T02:21:32.261ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2398 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6dae463c-3acc-4add-9be1-bf8cbe67409e response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
61412024-11-19T02:21:33.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c7800b95-46cb-4048-874d-eef005cc53b5 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
61422024-11-19T02:21:33.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c7800b95-46cb-4048-874d-eef005cc53b5 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
61432024-11-19T02:21:33.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2053 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c7800b95-46cb-4048-874d-eef005cc53b5 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
61442024-11-19T02:21:34.308ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 96dde315-6652-4cb4-9fad-00a273ef1954 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
61452024-11-19T02:21:34.308ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 96dde315-6652-4cb4-9fad-00a273ef1954 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
61462024-11-19T02:21:34.309ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1687 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 96dde315-6652-4cb4-9fad-00a273ef1954 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
61472024-11-19T02:21:35.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9ff6a97a-c37c-4481-9394-77934e55850f roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
61482024-11-19T02:21:35.333ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9ff6a97a-c37c-4481-9394-77934e55850f resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
61492024-11-19T02:21:35.335ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1996 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9ff6a97a-c37c-4481-9394-77934e55850f response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
61502024-11-19T02:21:35.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
61512024-11-19T02:21:35.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61522024-11-19T02:21:35.726ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
61532024-11-19T02:21:35.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61542024-11-19T02:21:35.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61552024-11-19T02:21:35.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61562024-11-19T02:21:35.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61572024-11-19T02:21:35.731ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
61582024-11-19T02:21:35.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61592024-11-19T02:21:35.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61602024-11-19T02:21:35.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61612024-11-19T02:21:35.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61622024-11-19T02:21:35.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61632024-11-19T02:21:35.737ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
61642024-11-19T02:21:35.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61652024-11-19T02:21:35.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61662024-11-19T02:21:35.752ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
61672024-11-19T02:21:35.752ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.475122ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
61682024-11-19T02:21:35.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61692024-11-19T02:21:35.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61702024-11-19T02:21:35.786ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.158738ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
61712024-11-19T02:21:36.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ae74c28b-c28e-453c-8ff4-d2998e60677a roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
61722024-11-19T02:21:36.357ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ae74c28b-c28e-453c-8ff4-d2998e60677a resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
61732024-11-19T02:21:36.359ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2059 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ae74c28b-c28e-453c-8ff4-d2998e60677a response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
61742024-11-19T02:21:37.156ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1897 local_addr = [fd00:1122:3344:101::c]:60807 method = GET remote_addr = [fd00:1122:3344:101::d]:57844 req_id = e06bbc04-1c28-45d8-80f5-b792d39b4bd2 response_code = 200 uri = /9f0b435f-0000-451e-9dbc-dcec71543c30
61752024-11-19T02:21:37.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 85ec5ac4-7648-4ba9-ad51-5ad5ad2e1c3c roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
61762024-11-19T02:21:37.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 85ec5ac4-7648-4ba9-ad51-5ad5ad2e1c3c resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
61772024-11-19T02:21:37.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2131 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 85ec5ac4-7648-4ba9-ad51-5ad5ad2e1c3c response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
61782024-11-19T02:21:38.405ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 573087b3-ba3d-4e02-a99d-929d391c7f14 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
61792024-11-19T02:21:38.405ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 573087b3-ba3d-4e02-a99d-929d391c7f14 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
61802024-11-19T02:21:38.407ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2045 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 573087b3-ba3d-4e02-a99d-929d391c7f14 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
61812024-11-19T02:21:39.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c10cfe69-a21b-48f4-bcb3-412dee42bfad roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
61822024-11-19T02:21:39.430ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c10cfe69-a21b-48f4-bcb3-412dee42bfad resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
61832024-11-19T02:21:39.432ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2317 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c10cfe69-a21b-48f4-bcb3-412dee42bfad response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
61842024-11-19T02:21:40.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ed4e6af6-6783-4964-86df-f2f60c83e771 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
61852024-11-19T02:21:40.455ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ed4e6af6-6783-4964-86df-f2f60c83e771 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
61862024-11-19T02:21:40.457ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2204 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ed4e6af6-6783-4964-86df-f2f60c83e771 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
61872024-11-19T02:21:41.478ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 73997f4f-18c1-4e8c-b904-b395869a5f4d roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
61882024-11-19T02:21:41.479ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 73997f4f-18c1-4e8c-b904-b395869a5f4d resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
61892024-11-19T02:21:41.481ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2384 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 73997f4f-18c1-4e8c-b904-b395869a5f4d response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
61902024-11-19T02:21:42.147ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = b91cb3b1-9d1b-4861-acbe-68ef891687f7 roles = RoleSet { roles: {} } uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?sort_by=id_ascending
61912024-11-19T02:21:42.147ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = b91cb3b1-9d1b-4861-acbe-68ef891687f7 resource = Database result = Ok(()) uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?sort_by=id_ascending
61922024-11-19T02:21:42.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3293 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = b91cb3b1-9d1b-4861-acbe-68ef891687f7 response_code = 200 uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?sort_by=id_ascending
61932024-11-19T02:21:42.150ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = 97d036f3-d8c7-40f6-9b14-e80b42c40839 roles = RoleSet { roles: {} } uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZmU3NDgyNC0wYzA4LTQ4ZTEtYTc1NS1mYjEyM2U4ZGMxODEifX0%3D
61942024-11-19T02:21:42.151ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = 97d036f3-d8c7-40f6-9b14-e80b42c40839 resource = Database result = Ok(()) uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZmU3NDgyNC0wYzA4LTQ4ZTEtYTc1NS1mYjEyM2U4ZGMxODEifX0%3D
61952024-11-19T02:21:42.153ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2678 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = 97d036f3-d8c7-40f6-9b14-e80b42c40839 response_code = 200 uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZmU3NDgyNC0wYzA4LTQ4ZTEtYTc1NS1mYjEyM2U4ZGMxODEifX0%3D
61962024-11-19T02:21:42.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ee523dda-1f85-40f9-a6d9-8c126a227c4e roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
61972024-11-19T02:21:42.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ee523dda-1f85-40f9-a6d9-8c126a227c4e resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
61982024-11-19T02:21:42.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2484 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ee523dda-1f85-40f9-a6d9-8c126a227c4e response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
61992024-11-19T02:21:43.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 406b817b-25f9-4feb-8654-8cc09ab1a957 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
62002024-11-19T02:21:43.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 406b817b-25f9-4feb-8654-8cc09ab1a957 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
62012024-11-19T02:21:43.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2270 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 406b817b-25f9-4feb-8654-8cc09ab1a957 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
62022024-11-19T02:21:44.554ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 63c71bb1-c1f4-4842-b7d8-d7b856800a83 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
62032024-11-19T02:21:44.554ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 63c71bb1-c1f4-4842-b7d8-d7b856800a83 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
62042024-11-19T02:21:44.556ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2061 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 63c71bb1-c1f4-4842-b7d8-d7b856800a83 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
62052024-11-19T02:21:45.580ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 7c8f6fe1-9759-4d3f-8bef-31a582ea2db8 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
62062024-11-19T02:21:45.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 7c8f6fe1-9759-4d3f-8bef-31a582ea2db8 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
62072024-11-19T02:21:45.582ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2357 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 7c8f6fe1-9759-4d3f-8bef-31a582ea2db8 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
62082024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
62092024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
62102024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
62112024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
62122024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
62132024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
62142024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
62152024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62162024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
62172024-11-19T02:21:45.726ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-19 02:11:45.726116735 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
62182024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
62192024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
62202024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
62212024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
62222024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
62232024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
62242024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62252024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
62262024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
62272024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
62282024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
62292024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62302024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62312024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
62322024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
62332024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
62342024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
62352024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
62362024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
62372024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
62382024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
62392024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
62402024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62412024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
62422024-11-19T02:21:45.726ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
62432024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
62442024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
62452024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
62462024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
62472024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
62482024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
62492024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
62502024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
62512024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
62522024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62532024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
62542024-11-19T02:21:45.726ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115
62552024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.63\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115"}
62562024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
62572024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
62582024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62592024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
62602024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
62612024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
62622024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
62632024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Timeout
62642024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62652024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
62662024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
62672024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
62682024-11-19T02:21:45.726ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
62692024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
62702024-11-19T02:21:45.726ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
62712024-11-19T02:21:45.727ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
62722024-11-19T02:21:45.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
62732024-11-19T02:21:45.727ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("27d1a6ca-1b76-4956-aefa-e234c7d60cd0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("91bdcbd0-987b-49c4-8200-fc3e8f332b6b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("91bdcbd0-987b-49c4-8200-fc3e8f332b6b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1603, tv_nsec: 510297402 } })
62742024-11-19T02:21:45.727ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62752024-11-19T02:21:45.727ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62762024-11-19T02:21:45.727ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62772024-11-19T02:21:45.727ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
62782024-11-19T02:21:45.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
62792024-11-19T02:21:45.727ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
62802024-11-19T02:21:45.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
62812024-11-19T02:21:45.727ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
62822024-11-19T02:21:45.727ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
62832024-11-19T02:21:45.727ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
62842024-11-19T02:21:45.727ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2d59cdb7-e3b1-4e94-afa3-f64f69928234.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a949a8d8-46c7-4423-b760-c03f98ccf638.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b190a9bf-d8b7-43c3-add4-e113c9b89870.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b190a9bf-d8b7-43c3-add4-e113c9b89870.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1603, tv_nsec: 510337863 } })
62852024-11-19T02:21:45.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
62862024-11-19T02:21:45.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62872024-11-19T02:21:45.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
62882024-11-19T02:21:45.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62892024-11-19T02:21:45.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62902024-11-19T02:21:45.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
62912024-11-19T02:21:45.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62922024-11-19T02:21:45.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
62932024-11-19T02:21:45.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
62942024-11-19T02:21:45.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
62952024-11-19T02:21:45.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
62962024-11-19T02:21:45.727ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
62972024-11-19T02:21:45.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62982024-11-19T02:21:45.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62992024-11-19T02:21:45.727ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
63002024-11-19T02:21:45.727ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.344476ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
63012024-11-19T02:21:45.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
63022024-11-19T02:21:45.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63032024-11-19T02:21:45.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
63042024-11-19T02:21:45.727ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
63052024-11-19T02:21:45.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63062024-11-19T02:21:45.727ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
63072024-11-19T02:21:45.727ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.496107ms iteration = 14 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
63082024-11-19T02:21:45.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
63092024-11-19T02:21:45.727ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
63102024-11-19T02:21:45.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
63112024-11-19T02:21:45.728ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63122024-11-19T02:21:45.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
63132024-11-19T02:21:45.728ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63142024-11-19T02:21:45.728ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
63152024-11-19T02:21:45.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63162024-11-19T02:21:45.729ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1603, tv_nsec: 513057244 } })
63172024-11-19T02:21:45.730ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
63182024-11-19T02:21:45.730ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
63192024-11-19T02:21:45.730ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63202024-11-19T02:21:45.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63212024-11-19T02:21:45.730ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-19 02:11:45.726116735 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
63222024-11-19T02:21:45.730ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.37253ms iteration = 13 status = {"expiration":"2024-11-19T02:11:45.726116735Z","pruned":[]}
63232024-11-19T02:21:45.732ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1603, tv_nsec: 516009417 } })
63242024-11-19T02:21:45.732ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
63252024-11-19T02:21:45.733ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.571726ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
63262024-11-19T02:21:45.733ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63272024-11-19T02:21:45.734ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63282024-11-19T02:21:45.736ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63292024-11-19T02:21:45.736ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
63302024-11-19T02:21:45.736ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
63312024-11-19T02:21:45.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
63322024-11-19T02:21:45.737ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
63332024-11-19T02:21:45.737ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
63342024-11-19T02:21:45.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
63352024-11-19T02:21:45.738ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
63362024-11-19T02:21:45.738ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63372024-11-19T02:21:45.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63382024-11-19T02:21:45.741ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63392024-11-19T02:21:45.744ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
63402024-11-19T02:21:45.744ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63412024-11-19T02:21:45.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63422024-11-19T02:21:45.749ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63432024-11-19T02:21:45.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63442024-11-19T02:21:45.750ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 23.247406ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
63452024-11-19T02:21:45.751ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63462024-11-19T02:21:45.752ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63472024-11-19T02:21:45.753ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63482024-11-19T02:21:45.760ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
63492024-11-19T02:21:45.760ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
63502024-11-19T02:21:45.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
63512024-11-19T02:21:45.760ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
63522024-11-19T02:21:45.760ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63532024-11-19T02:21:45.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63542024-11-19T02:21:45.761ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
63552024-11-19T02:21:45.763ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63562024-11-19T02:21:45.764ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63572024-11-19T02:21:45.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63582024-11-19T02:21:45.767ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
63592024-11-19T02:21:45.772ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63602024-11-19T02:21:45.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63612024-11-19T02:21:45.773ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1603, tv_nsec: 556816595 } })
63622024-11-19T02:21:45.773ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
63632024-11-19T02:21:45.777ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 51.133785ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
63642024-11-19T02:21:45.782ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63652024-11-19T02:21:45.782ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63662024-11-19T02:21:45.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63672024-11-19T02:21:45.784ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63682024-11-19T02:21:45.785ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
63692024-11-19T02:21:45.785ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
63702024-11-19T02:21:45.785ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63712024-11-19T02:21:45.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63722024-11-19T02:21:45.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
63732024-11-19T02:21:45.786ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
63742024-11-19T02:21:45.786ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
63752024-11-19T02:21:45.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
63762024-11-19T02:21:45.786ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 60.076838ms iteration = 25 status = {"errors":[],"records_set_to_done":[]}
63772024-11-19T02:21:45.788ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
63782024-11-19T02:21:45.788ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63792024-11-19T02:21:45.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
63802024-11-19T02:21:45.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63812024-11-19T02:21:45.789ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63822024-11-19T02:21:45.789ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63832024-11-19T02:21:45.790ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
63842024-11-19T02:21:45.791ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
63852024-11-19T02:21:45.791ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
63862024-11-19T02:21:45.791ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 64.048464ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
63872024-11-19T02:21:45.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
63882024-11-19T02:21:45.791ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63892024-11-19T02:21:45.791ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63902024-11-19T02:21:45.792ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
63912024-11-19T02:21:45.792ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63922024-11-19T02:21:45.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63932024-11-19T02:21:45.793ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
63942024-11-19T02:21:45.793ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63952024-11-19T02:21:45.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63962024-11-19T02:21:45.794ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
63972024-11-19T02:21:45.794ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
63982024-11-19T02:21:45.794ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
63992024-11-19T02:21:45.794ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64002024-11-19T02:21:45.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
64012024-11-19T02:21:45.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64022024-11-19T02:21:45.795ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64032024-11-19T02:21:45.795ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
64042024-11-19T02:21:45.796ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
64052024-11-19T02:21:45.796ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
64062024-11-19T02:21:45.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
64072024-11-19T02:21:45.797ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
64082024-11-19T02:21:45.798ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
64092024-11-19T02:21:45.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
64102024-11-19T02:21:45.800ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
64112024-11-19T02:21:45.800ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
64122024-11-19T02:21:45.800ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
64132024-11-19T02:21:45.800ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
64142024-11-19T02:21:45.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
64152024-11-19T02:21:45.801ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64162024-11-19T02:21:45.802ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
64172024-11-19T02:21:45.802ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
64182024-11-19T02:21:45.802ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
64192024-11-19T02:21:45.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
64202024-11-19T02:21:45.804ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
64212024-11-19T02:21:45.804ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64222024-11-19T02:21:45.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64232024-11-19T02:21:45.806ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64242024-11-19T02:21:45.814ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
64252024-11-19T02:21:45.814ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
64262024-11-19T02:21:45.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
64272024-11-19T02:21:45.817ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64282024-11-19T02:21:45.817ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
64292024-11-19T02:21:45.817ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
64302024-11-19T02:21:45.817ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
64312024-11-19T02:21:45.817ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
64322024-11-19T02:21:45.817ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
64332024-11-19T02:21:45.817ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 91.227154ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
64342024-11-19T02:21:45.817ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
64352024-11-19T02:21:45.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
64362024-11-19T02:21:45.820ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64372024-11-19T02:21:45.821ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
64382024-11-19T02:21:45.821ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
64392024-11-19T02:21:45.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
64402024-11-19T02:21:45.822ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64412024-11-19T02:21:45.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64422024-11-19T02:21:45.823ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 96.844089ms iteration = 6 status = {"nsuccess":5}
64432024-11-19T02:21:45.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
64442024-11-19T02:21:45.823ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
64452024-11-19T02:21:45.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
64462024-11-19T02:21:45.824ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 97.717838ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
64472024-11-19T02:21:45.826ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64482024-11-19T02:21:45.826ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
64492024-11-19T02:21:45.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64502024-11-19T02:21:45.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
64512024-11-19T02:21:45.828ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64522024-11-19T02:21:45.831ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: ffe74824-0c08-48e1-a755-fb123e8dc181, lookup_type: ById(ffe74824-0c08-48e1-a755-fb123e8dc181) } result = Ok(())
64532024-11-19T02:21:45.831ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64542024-11-19T02:21:45.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64552024-11-19T02:21:45.831ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
64562024-11-19T02:21:45.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
64572024-11-19T02:21:45.832ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64582024-11-19T02:21:45.832ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 105.836782ms iteration = 25 status = 0
64592024-11-19T02:21:45.834ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
64602024-11-19T02:21:45.834ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64612024-11-19T02:21:45.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64622024-11-19T02:21:45.835ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
64632024-11-19T02:21:45.835ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 109.201681ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
64642024-11-19T02:21:45.842ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 116.011198ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
64652024-11-19T02:21:45.844ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
64662024-11-19T02:21:45.844ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 117.523505ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
64672024-11-19T02:21:45.844ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64682024-11-19T02:21:45.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64692024-11-19T02:21:45.849ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 122.489002ms iteration = 25 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
64702024-11-19T02:21:45.849ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 122.656024ms iteration = 29 status = {"physical_disks_added":0}
64712024-11-19T02:21:45.850ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
64722024-11-19T02:21:45.850ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
64732024-11-19T02:21:45.850ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 123.250271ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
64742024-11-19T02:21:45.853ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
64752024-11-19T02:21:45.853ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = af79c7eb-bc4d-42f8-9217-8b35affeeebb dns_zone_name = oxide.test found_so_far = 0 version = 2
64762024-11-19T02:21:45.853ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
64772024-11-19T02:21:45.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
64782024-11-19T02:21:45.855ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
64792024-11-19T02:21:45.855ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64802024-11-19T02:21:45.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
64812024-11-19T02:21:45.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
64822024-11-19T02:21:45.858ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
64832024-11-19T02:21:45.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
64842024-11-19T02:21:45.860ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = af79c7eb-bc4d-42f8-9217-8b35affeeebb dns_zone_name = oxide.test found_so_far = 1 version = 2
64852024-11-19T02:21:45.860ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
64862024-11-19T02:21:45.860ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-19 02:10:28.769117 UTC dns_group = external generation = 2
64872024-11-19T02:21:45.860ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 134.388668ms iteration = 14 status = {"generation":2}
64882024-11-19T02:21:45.865ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
64892024-11-19T02:21:45.865ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 8c04fa4d-031f-4603-9b0e-246b45d39276 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
64902024-11-19T02:21:45.865ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
64912024-11-19T02:21:45.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
64922024-11-19T02:21:45.867ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64932024-11-19T02:21:45.867ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 140.905872ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
64942024-11-19T02:21:45.870ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
64952024-11-19T02:21:45.870ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
64962024-11-19T02:21:45.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
64972024-11-19T02:21:45.873ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 8c04fa4d-031f-4603-9b0e-246b45d39276 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
64982024-11-19T02:21:45.873ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
64992024-11-19T02:21:45.873ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-19 02:10:27.714570 UTC dns_group = internal generation = 1
65002024-11-19T02:21:45.873ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 147.255456ms iteration = 14 status = {"generation":1}
65012024-11-19T02:21:45.875ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
65022024-11-19T02:21:45.875ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
65032024-11-19T02:21:45.875ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "35bc2f39-7c83-45fa-881d-e795c6d450a2", "content-length": "26", "date": "Tue, 19 Nov 2024 02:21:45 GMT"} })
65042024-11-19T02:21:45.875ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
65052024-11-19T02:21:45.877ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
65062024-11-19T02:21:45.885ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65072024-11-19T02:21:45.887ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
65082024-11-19T02:21:45.887ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
65092024-11-19T02:21:45.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
65102024-11-19T02:21:45.925ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
65112024-11-19T02:21:45.926ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 198.982067ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
65122024-11-19T02:21:45.927ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-19T02:09:41.910054Z, time_modified: 2024-11-19T02:09:41.910054Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 78638afa-e975-44a9-b764-0afec18d156f, db_silo: Silo { identity: SiloIdentity { id: 78638afa-e975-44a9-b764-0afec18d156f, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-19T02:10:28.623188Z, time_modified: 2024-11-19T02:10:28.623188Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "fe94815f3f5502a309deafc95cd58d4fe61e984b7bd8ad11309589068beb64f5" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 78638afa-e975-44a9-b764-0afec18d156f, db_silo: Silo { identity: SiloIdentity { id: 78638afa-e975-44a9-b764-0afec18d156f, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-19T02:10:28.623188Z, time_modified: 2024-11-19T02:10:28.623188Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "fe94815f3f5502a309deafc95cd58d4fe61e984b7bd8ad11309589068beb64f5" }] }) }
65132024-11-19T02:21:45.927ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 200.92951ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"78638afa-e975-44a9-b764-0afec18d156f","tls_certs":["fe94815f3f5502a309deafc95cd58d4fe61e984b7bd8ad11309589068beb64f5"]}},"default_endpoint":{"silo_id":"78638afa-e975-44a9-b764-0afec18d156f","tls_certs":["fe94815f3f5502a309deafc95cd58d4fe61e984b7bd8ad11309589068beb64f5"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
65142024-11-19T02:21:45.964ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65152024-11-19T02:21:45.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65162024-11-19T02:21:45.967ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65172024-11-19T02:21:45.969ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
65182024-11-19T02:21:45.969ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65192024-11-19T02:21:45.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65202024-11-19T02:21:46.005ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
65212024-11-19T02:21:46.033ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
65222024-11-19T02:21:46.038ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
65232024-11-19T02:21:46.038ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
65242024-11-19T02:21:46.039ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2501949c-6c26-4d49-9d2d-d61e4c2e661c", "content-length": "26", "date": "Tue, 19 Nov 2024 02:21:45 GMT"} })
65252024-11-19T02:21:46.039ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
65262024-11-19T02:21:46.041ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
65272024-11-19T02:21:46.101ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 375.554079ms iteration = 25 status = {}
65282024-11-19T02:21:46.144ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 zone_address = fd00:1122:3344:101::2
65292024-11-19T02:21:46.144ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
65302024-11-19T02:21:46.145ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2b8a411c-ffad-4ecb-8b2b-39babce54b5a", "content-length": "26", "date": "Tue, 19 Nov 2024 02:21:45 GMT"} })
65312024-11-19T02:21:46.145ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
65322024-11-19T02:21:46.147ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
65332024-11-19T02:21:46.216ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
65342024-11-19T02:21:46.217ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "86171e8f-96a0-445c-9989-f859e327328f", "content-length": "1", "date": "Tue, 19 Nov 2024 02:21:45 GMT"} })
65352024-11-19T02:21:46.219ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
65362024-11-19T02:21:46.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
65372024-11-19T02:21:46.259ZINFOnexus (BackgroundTasks): VPC route manager sled ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
65382024-11-19T02:21:46.259ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
65392024-11-19T02:21:46.260ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "5394ef87-00ef-49df-9e77-d46a13ee3c71", "content-length": "372", "date": "Tue, 19 Nov 2024 02:21:46 GMT"} })
65402024-11-19T02:21:46.260ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65412024-11-19T02:21:46.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65422024-11-19T02:21:46.262ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65432024-11-19T02:21:46.263ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 536.811224ms iteration = 25 status = null
65442024-11-19T02:21:46.264ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
65452024-11-19T02:21:46.264ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65462024-11-19T02:21:46.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65472024-11-19T02:21:46.279ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
65482024-11-19T02:21:46.279ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "8f5c65dc-3ff2-4098-9d28-82aa40683345", "date": "Tue, 19 Nov 2024 02:21:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
65492024-11-19T02:21:46.279ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
65502024-11-19T02:21:46.281ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "5fea1590-9fa9-4025-9f0d-02526fedeac4", "date": "Tue, 19 Nov 2024 02:21:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
65512024-11-19T02:21:46.281ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
65522024-11-19T02:21:46.283ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
65532024-11-19T02:21:46.283ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 556.956185ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
65542024-11-19T02:21:46.286ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
65552024-11-19T02:21:46.305ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
65562024-11-19T02:21:46.305ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
65572024-11-19T02:21:46.305ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "63e9af8a-e63d-4da3-8dab-253f8cea4d1a", "date": "Tue, 19 Nov 2024 02:21:46 GMT"} })
65582024-11-19T02:21:46.305ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65592024-11-19T02:21:46.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65602024-11-19T02:21:46.307ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65612024-11-19T02:21:46.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65622024-11-19T02:21:46.310ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65632024-11-19T02:21:46.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65642024-11-19T02:21:46.314ZINFOnexus (BackgroundTasks): VPC route manager sled ffe74824-0c08-48e1-a755-fb123e8dc181 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
65652024-11-19T02:21:46.315ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
65662024-11-19T02:21:46.315ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "606ae1b8-5bd3-4486-b096-5f41fa2dbd71", "date": "Tue, 19 Nov 2024 02:21:46 GMT"} })
65672024-11-19T02:21:46.317ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 590.279276ms iteration = 26 status = {}
65682024-11-19T02:21:46.364ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
65692024-11-19T02:21:46.365ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "01ba9ad6-5b7d-48da-adc8-44ea69c9a50f", "content-length": "691", "date": "Tue, 19 Nov 2024 02:21:46 GMT"} })
65702024-11-19T02:21:46.365ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
65712024-11-19T02:21:46.365ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
65722024-11-19T02:21:46.365ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
65732024-11-19T02:21:46.366ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 639.470989ms iteration = 25 status = {}
65742024-11-19T02:21:46.439ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
65752024-11-19T02:21:46.440ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "a491e3a4-ae55-436b-bed8-850d067cad43", "date": "Tue, 19 Nov 2024 02:21:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
65762024-11-19T02:21:46.440ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
65772024-11-19T02:21:46.443ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "22e6aae2-c501-48d6-a43f-5bca1999b968", "date": "Tue, 19 Nov 2024 02:21:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
65782024-11-19T02:21:46.443ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
65792024-11-19T02:21:46.445ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "405586fe-54cf-431b-8a10-1df6cedb1661", "date": "Tue, 19 Nov 2024 02:21:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
65802024-11-19T02:21:46.445ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
65812024-11-19T02:21:46.447ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
65822024-11-19T02:21:46.447ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 721.221435ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
65832024-11-19T02:21:46.482ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65842024-11-19T02:21:46.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65852024-11-19T02:21:46.484ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 20bc3881-e2ee-4d8d-b84b-b0c1e478721f, rack_id: a894e92e-d765-4f15-b6b7-cb9ca46d1860, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8597d802-6d4d-4493-88de-333a1f340c20) } rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0
65862024-11-19T02:21:46.484ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65872024-11-19T02:21:46.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65882024-11-19T02:21:46.493ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
65892024-11-19T02:21:46.493ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "77aa61c9-551b-428a-85a3-bf2c8a5eb092", "content-length": "134", "date": "Tue, 19 Nov 2024 02:21:46 GMT"} })
65902024-11-19T02:21:46.494ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
65912024-11-19T02:21:46.494ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8597d802-6d4d-4493-88de-333a1f340c20
65922024-11-19T02:21:46.494ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
65932024-11-19T02:21:46.494ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
65942024-11-19T02:21:46.494ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
65952024-11-19T02:21:46.494ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
65962024-11-19T02:21:46.494ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
65972024-11-19T02:21:46.494ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
65982024-11-19T02:21:46.494ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
65992024-11-19T02:21:46.494ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
66002024-11-19T02:21:46.495ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
66012024-11-19T02:21:46.495ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66022024-11-19T02:21:46.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66032024-11-19T02:21:46.497ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
66042024-11-19T02:21:46.497ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "78c1b65f-9742-41bc-910a-d72f680e4fe2", "content-length": "2", "date": "Tue, 19 Nov 2024 02:21:46 GMT"} })
66052024-11-19T02:21:46.497ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
66062024-11-19T02:21:46.497ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ed27b95-a1f9-4a51-ad07-17a6df937bf4", "content-length": "52", "date": "Tue, 19 Nov 2024 02:21:46 GMT"} })
66072024-11-19T02:21:46.497ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0
66082024-11-19T02:21:46.497ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
66092024-11-19T02:21:46.599ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4fdaf647-d900-4a50-ba82-a2ec3b13babf", "date": "Tue, 19 Nov 2024 02:21:46 GMT"} })
66102024-11-19T02:21:46.599ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch = Switch0
66112024-11-19T02:21:46.599ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
66122024-11-19T02:21:46.600ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e616def9-9904-4357-a876-a8b46228cc67", "content-length": "682", "date": "Tue, 19 Nov 2024 02:21:46 GMT"} })
66132024-11-19T02:21:46.600ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66142024-11-19T02:21:46.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66152024-11-19T02:21:46.604ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66162024-11-19T02:21:46.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66172024-11-19T02:21:46.607ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66182024-11-19T02:21:46.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66192024-11-19T02:21:46.608ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = fab5db93-a9a5-4ff7-802d-fdc0ccacde11 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
66202024-11-19T02:21:46.608ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = fab5db93-a9a5-4ff7-802d-fdc0ccacde11 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
66212024-11-19T02:21:46.609ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1758 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = fab5db93-a9a5-4ff7-802d-fdc0ccacde11 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
66222024-11-19T02:21:46.609ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66232024-11-19T02:21:46.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66242024-11-19T02:21:46.617ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 891.085509ms iteration = 25 status = {}
66252024-11-19T02:21:47.115ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = ec6d8ec0-3f10-4038-8fd4-ea990087edf1 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
66262024-11-19T02:21:47.116ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = ec6d8ec0-3f10-4038-8fd4-ea990087edf1 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
66272024-11-19T02:21:47.123ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7432 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = ec6d8ec0-3f10-4038-8fd4-ea990087edf1 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
66282024-11-19T02:21:47.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = bc0629fe-6934-4faf-99e4-9b0e0fbc3bd8 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
66292024-11-19T02:21:47.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = bc0629fe-6934-4faf-99e4-9b0e0fbc3bd8 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
66302024-11-19T02:21:47.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2294 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = bc0629fe-6934-4faf-99e4-9b0e0fbc3bd8 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
66312024-11-19T02:21:48.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 74bbebe8-5313-4669-9eca-8c894f2cad36 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
66322024-11-19T02:21:48.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 74bbebe8-5313-4669-9eca-8c894f2cad36 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
66332024-11-19T02:21:48.667ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2507 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 74bbebe8-5313-4669-9eca-8c894f2cad36 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
66342024-11-19T02:21:49.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 153ef811-9f55-42c0-b0bc-e5155d6048ea roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
66352024-11-19T02:21:49.689ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 153ef811-9f55-42c0-b0bc-e5155d6048ea resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
66362024-11-19T02:21:49.690ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1848 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 153ef811-9f55-42c0-b0bc-e5155d6048ea response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
66372024-11-19T02:21:50.713ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0f755ade-3b0a-4f27-b3b8-46f4c6c14e77 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
66382024-11-19T02:21:50.713ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0f755ade-3b0a-4f27-b3b8-46f4c6c14e77 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
66392024-11-19T02:21:50.715ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1948 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0f755ade-3b0a-4f27-b3b8-46f4c6c14e77 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
66402024-11-19T02:21:51.738ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c9ae208e-37cc-4e71-bc07-770369a8eccc roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
66412024-11-19T02:21:51.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c9ae208e-37cc-4e71-bc07-770369a8eccc resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
66422024-11-19T02:21:51.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2197 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c9ae208e-37cc-4e71-bc07-770369a8eccc response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
66432024-11-19T02:21:52.156ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1344 local_addr = [fd00:1122:3344:101::c]:60807 method = GET remote_addr = [fd00:1122:3344:101::d]:57844 req_id = 4bcb3e23-7a5b-4607-9aea-61f5ac297460 response_code = 200 uri = /9f0b435f-0000-451e-9dbc-dcec71543c30
66442024-11-19T02:21:52.762ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 99cbc8d8-6f32-4ae2-828d-4e16b65f55bf roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
66452024-11-19T02:21:52.763ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 99cbc8d8-6f32-4ae2-828d-4e16b65f55bf resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
66462024-11-19T02:21:52.764ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2129 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 99cbc8d8-6f32-4ae2-828d-4e16b65f55bf response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
66472024-11-19T02:21:53.795ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0895fc8a-c91a-4e2f-a6c2-a75ce781e57f roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
66482024-11-19T02:21:53.795ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0895fc8a-c91a-4e2f-a6c2-a75ce781e57f resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
66492024-11-19T02:21:53.797ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2333 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0895fc8a-c91a-4e2f-a6c2-a75ce781e57f response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
66502024-11-19T02:21:54.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = 828ccb9a-659e-4d86-9218-d6a2ef5eb318 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
66512024-11-19T02:21:54.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = 828ccb9a-659e-4d86-9218-d6a2ef5eb318 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
66522024-11-19T02:21:54.138ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7143 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = 828ccb9a-659e-4d86-9218-d6a2ef5eb318 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
66532024-11-19T02:21:54.142ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = b2c99e9e-f3ca-4607-b53c-42a208c0dc1d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
66542024-11-19T02:21:54.143ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = b2c99e9e-f3ca-4607-b53c-42a208c0dc1d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
66552024-11-19T02:21:54.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4433 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = b2c99e9e-f3ca-4607-b53c-42a208c0dc1d response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
66562024-11-19T02:21:54.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b5cef6c5-18a2-4e87-8b8c-da3e7c256afc roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
66572024-11-19T02:21:54.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b5cef6c5-18a2-4e87-8b8c-da3e7c256afc resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
66582024-11-19T02:21:54.823ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2512 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b5cef6c5-18a2-4e87-8b8c-da3e7c256afc response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
66592024-11-19T02:21:55.726ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
66602024-11-19T02:21:55.726ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
66612024-11-19T02:21:55.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66622024-11-19T02:21:55.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66632024-11-19T02:21:55.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66642024-11-19T02:21:55.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66652024-11-19T02:21:55.730ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66662024-11-19T02:21:55.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66672024-11-19T02:21:55.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66682024-11-19T02:21:55.732ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 6.10728ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
66692024-11-19T02:21:55.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
66702024-11-19T02:21:55.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66712024-11-19T02:21:55.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66722024-11-19T02:21:55.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66732024-11-19T02:21:55.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66742024-11-19T02:21:55.740ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66752024-11-19T02:21:55.744ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
66762024-11-19T02:21:55.744ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66772024-11-19T02:21:55.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66782024-11-19T02:21:55.757ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
66792024-11-19T02:21:55.757ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 31.033065ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
66802024-11-19T02:21:55.846ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 629731c1-ee49-4d86-832d-b3214cf1e2ce roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
66812024-11-19T02:21:55.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 629731c1-ee49-4d86-832d-b3214cf1e2ce resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
66822024-11-19T02:21:55.849ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3226 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 629731c1-ee49-4d86-832d-b3214cf1e2ce response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
66832024-11-19T02:21:56.880ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 2b3da9f7-0f29-441c-96ea-61d01f42c986 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
66842024-11-19T02:21:56.880ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 2b3da9f7-0f29-441c-96ea-61d01f42c986 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
66852024-11-19T02:21:56.882ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2838 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 2b3da9f7-0f29-441c-96ea-61d01f42c986 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
66862024-11-19T02:21:57.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3988568e-3c0b-452b-9e30-6da8f832e9b8 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
66872024-11-19T02:21:57.914ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3988568e-3c0b-452b-9e30-6da8f832e9b8 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
66882024-11-19T02:21:57.916ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2700 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3988568e-3c0b-452b-9e30-6da8f832e9b8 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
66892024-11-19T02:21:58.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 25ff8354-7f3f-4f46-b4d6-cae0afeb2d6b roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
66902024-11-19T02:21:58.939ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 25ff8354-7f3f-4f46-b4d6-cae0afeb2d6b resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
66912024-11-19T02:21:58.941ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2139 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 25ff8354-7f3f-4f46-b4d6-cae0afeb2d6b response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
66922024-11-19T02:21:59.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 18269f69-3c53-40c0-bd36-1c8408dce24a roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
66932024-11-19T02:21:59.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 18269f69-3c53-40c0-bd36-1c8408dce24a resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
66942024-11-19T02:21:59.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2345 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 18269f69-3c53-40c0-bd36-1c8408dce24a response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
66952024-11-19T02:22:00.955ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = e917287e-a0d9-4025-b75c-a5f9cb0524d2 remote_addr = [fd00:1122:3344:101::1]:47082 req_id = fd47ae48-7d63-4b8b-aee1-300a3071e83b uri = /vmms/e917287e-a0d9-4025-b75c-a5f9cb0524d2 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-19T02:22:00.951975507Z }
66962024-11-19T02:22:00.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47082 req_id = fd47ae48-7d63-4b8b-aee1-300a3071e83b roles = RoleSet { roles: {} } uri = /vmms/e917287e-a0d9-4025-b75c-a5f9cb0524d2
66972024-11-19T02:22:00.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47082 req_id = fd47ae48-7d63-4b8b-aee1-300a3071e83b resource = Database result = Ok(()) uri = /vmms/e917287e-a0d9-4025-b75c-a5f9cb0524d2
66982024-11-19T02:22:00.990ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1:0]:35478
66992024-11-19T02:22:00.991ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:35478 req_id = a0ea629f-8c35-47ab-bd7c-6a2a7a2c0672 roles = RoleSet { roles: {} } uri = /metrics/producers
67002024-11-19T02:22:00.991ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:35478 req_id = a0ea629f-8c35-47ab-bd7c-6a2a7a2c0672 resource = Database result = Ok(()) uri = /metrics/producers
67012024-11-19T02:22:00.993ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:52041
67022024-11-19T02:22:00.993ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52041 req_id = 0540272d-1b1f-4a20-a47f-feff02a010c9 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
67032024-11-19T02:22:00.993ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52041 req_id = 0540272d-1b1f-4a20-a47f-feff02a010c9 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
67042024-11-19T02:22:00.995ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1932 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:52041 req_id = 0540272d-1b1f-4a20-a47f-feff02a010c9 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
67052024-11-19T02:22:01.008ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56114 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47082 req_id = fd47ae48-7d63-4b8b-aee1-300a3071e83b response_code = 204 uri = /vmms/e917287e-a0d9-4025-b75c-a5f9cb0524d2
67062024-11-19T02:22:01.009ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = e917287e-a0d9-4025-b75c-a5f9cb0524d2 remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 18e6aa4e-40a1-44b0-9087-e7b43143faf7 uri = /vmms/e917287e-a0d9-4025-b75c-a5f9cb0524d2 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-19T02:22:01.008909469Z }
67072024-11-19T02:22:01.009ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 18e6aa4e-40a1-44b0-9087-e7b43143faf7 roles = RoleSet { roles: {} } uri = /vmms/e917287e-a0d9-4025-b75c-a5f9cb0524d2
67082024-11-19T02:22:01.009ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 18e6aa4e-40a1-44b0-9087-e7b43143faf7 resource = Database result = Ok(()) uri = /vmms/e917287e-a0d9-4025-b75c-a5f9cb0524d2
67092024-11-19T02:22:01.035ZINFOnexus: assigned collector to new producer collector_id = 3980dd20-a3be-40d3-b9e5-094b8ed4b785 file = nexus/src/app/oximeter.rs:76 producer_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947
67102024-11-19T02:22:01.035ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44753 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:35478 req_id = a0ea629f-8c35-47ab-bd7c-6a2a7a2c0672 response_code = 201 uri = /metrics/producers
67112024-11-19T02:22:01.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41582 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 18e6aa4e-40a1-44b0-9087-e7b43143faf7 response_code = 204 uri = /vmms/e917287e-a0d9-4025-b75c-a5f9cb0524d2
67122024-11-19T02:22:02.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6cfed89c-cbf6-4650-9fe4-17531d3a7468 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
67132024-11-19T02:22:02.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6cfed89c-cbf6-4650-9fe4-17531d3a7468 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
67142024-11-19T02:22:02.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2567 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6cfed89c-cbf6-4650-9fe4-17531d3a7468 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
67152024-11-19T02:22:03.046ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 1bb3bd5c-43f6-494a-8900-474b85aeef30 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
67162024-11-19T02:22:03.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 1bb3bd5c-43f6-494a-8900-474b85aeef30 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
67172024-11-19T02:22:03.048ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2380 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 1bb3bd5c-43f6-494a-8900-474b85aeef30 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
67182024-11-19T02:22:04.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 7d93724c-c9f5-48c6-ae23-df713dc53240 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
67192024-11-19T02:22:04.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 7d93724c-c9f5-48c6-ae23-df713dc53240 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
67202024-11-19T02:22:04.072ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2146 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 7d93724c-c9f5-48c6-ae23-df713dc53240 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
67212024-11-19T02:22:05.096ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 60bf6ed2-655a-4d97-b782-9f61b844057d roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
67222024-11-19T02:22:05.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 60bf6ed2-655a-4d97-b782-9f61b844057d resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
67232024-11-19T02:22:05.099ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2617 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 60bf6ed2-655a-4d97-b782-9f61b844057d response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
67242024-11-19T02:22:05.727ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
67252024-11-19T02:22:05.727ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
67262024-11-19T02:22:05.727ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67272024-11-19T02:22:05.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67282024-11-19T02:22:05.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67292024-11-19T02:22:05.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67302024-11-19T02:22:05.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67312024-11-19T02:22:05.730ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67322024-11-19T02:22:05.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67332024-11-19T02:22:05.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
67342024-11-19T02:22:05.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67352024-11-19T02:22:05.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67362024-11-19T02:22:05.732ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.22709ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
67372024-11-19T02:22:05.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67382024-11-19T02:22:05.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67392024-11-19T02:22:05.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67402024-11-19T02:22:05.739ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
67412024-11-19T02:22:05.739ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67422024-11-19T02:22:05.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67432024-11-19T02:22:05.752ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
67442024-11-19T02:22:05.752ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.918435ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
67452024-11-19T02:22:06.121ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 61f5068d-a865-400a-b420-3e944812128e roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
67462024-11-19T02:22:06.121ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 61f5068d-a865-400a-b420-3e944812128e resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
67472024-11-19T02:22:06.123ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2172 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 61f5068d-a865-400a-b420-3e944812128e response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
67482024-11-19T02:22:07.147ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a7089eba-5efe-4508-a7a7-4a938959267f roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
67492024-11-19T02:22:07.147ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a7089eba-5efe-4508-a7a7-4a938959267f resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
67502024-11-19T02:22:07.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2655 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a7089eba-5efe-4508-a7a7-4a938959267f response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
67512024-11-19T02:22:07.156ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1355 local_addr = [fd00:1122:3344:101::c]:60807 method = GET remote_addr = [fd00:1122:3344:101::d]:57844 req_id = 7327e7c1-bccf-44e9-867f-4d6ce692c4e1 response_code = 200 uri = /9f0b435f-0000-451e-9dbc-dcec71543c30
67522024-11-19T02:22:08.173ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6a5483c4-f4de-4f82-87e2-c840bcf8d926 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
67532024-11-19T02:22:08.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6a5483c4-f4de-4f82-87e2-c840bcf8d926 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
67542024-11-19T02:22:08.175ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1848 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6a5483c4-f4de-4f82-87e2-c840bcf8d926 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
67552024-11-19T02:22:09.197ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 86225806-348c-45fc-85de-0e35dbdaa32c roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
67562024-11-19T02:22:09.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 86225806-348c-45fc-85de-0e35dbdaa32c resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
67572024-11-19T02:22:09.199ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2675 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 86225806-348c-45fc-85de-0e35dbdaa32c response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
67582024-11-19T02:22:10.224ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 7ce20eef-3b02-42fa-abf9-89172bac6fd4 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
67592024-11-19T02:22:10.224ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 7ce20eef-3b02-42fa-abf9-89172bac6fd4 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
67602024-11-19T02:22:10.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2157 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 7ce20eef-3b02-42fa-abf9-89172bac6fd4 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
67612024-11-19T02:22:11.251ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c3c60d69-d82d-4afe-aeda-ad1737dff1fb roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
67622024-11-19T02:22:11.251ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c3c60d69-d82d-4afe-aeda-ad1737dff1fb resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
67632024-11-19T02:22:11.253ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2083 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c3c60d69-d82d-4afe-aeda-ad1737dff1fb response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
67642024-11-19T02:22:11.333ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = e917287e-a0d9-4025-b75c-a5f9cb0524d2 remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 07c1698e-3310-422b-af1e-c92b4d52cca5 uri = /vmms/e917287e-a0d9-4025-b75c-a5f9cb0524d2 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-19T02:22:11.333202969Z }
67652024-11-19T02:22:11.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 07c1698e-3310-422b-af1e-c92b4d52cca5 roles = RoleSet { roles: {} } uri = /vmms/e917287e-a0d9-4025-b75c-a5f9cb0524d2
67662024-11-19T02:22:11.333ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 07c1698e-3310-422b-af1e-c92b4d52cca5 resource = Database result = Ok(()) uri = /vmms/e917287e-a0d9-4025-b75c-a5f9cb0524d2
67672024-11-19T02:22:11.355ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 22413 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 07c1698e-3310-422b-af1e-c92b4d52cca5 response_code = 204 uri = /vmms/e917287e-a0d9-4025-b75c-a5f9cb0524d2
67682024-11-19T02:22:12.165ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = 8ae476d7-575c-4db5-b201-8412f685fbe8 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
67692024-11-19T02:22:12.165ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = 8ae476d7-575c-4db5-b201-8412f685fbe8 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
67702024-11-19T02:22:12.167ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2540 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = 8ae476d7-575c-4db5-b201-8412f685fbe8 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
67712024-11-19T02:22:12.168ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = ae74d8b7-2e7b-44b8-a8a0-eb5f50645365 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
67722024-11-19T02:22:12.169ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = ae74d8b7-2e7b-44b8-a8a0-eb5f50645365 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
67732024-11-19T02:22:12.171ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3123 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = ae74d8b7-2e7b-44b8-a8a0-eb5f50645365 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
67742024-11-19T02:22:12.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = daeed3a5-edea-4d49-95f2-7142eb2876b6 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
67752024-11-19T02:22:12.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = daeed3a5-edea-4d49-95f2-7142eb2876b6 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
67762024-11-19T02:22:12.278ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2550 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = daeed3a5-edea-4d49-95f2-7142eb2876b6 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
67772024-11-19T02:22:13.173ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = bc8e677f-1c40-4e75-999b-3889547dfcb7 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
67782024-11-19T02:22:13.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = bc8e677f-1c40-4e75-999b-3889547dfcb7 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
67792024-11-19T02:22:13.176ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3626 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = bc8e677f-1c40-4e75-999b-3889547dfcb7 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
67802024-11-19T02:22:13.300ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 568282cb-7019-4fe8-8c96-8f8eef42c8e1 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
67812024-11-19T02:22:13.301ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 568282cb-7019-4fe8-8c96-8f8eef42c8e1 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
67822024-11-19T02:22:13.303ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2377 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 568282cb-7019-4fe8-8c96-8f8eef42c8e1 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
67832024-11-19T02:22:13.798ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = e917287e-a0d9-4025-b75c-a5f9cb0524d2 remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c1cd9a82-87c6-4afe-85fe-f18f25b0ffe4 uri = /vmms/e917287e-a0d9-4025-b75c-a5f9cb0524d2 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-19T02:22:13.797947680Z }
67842024-11-19T02:22:13.798ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c1cd9a82-87c6-4afe-85fe-f18f25b0ffe4 roles = RoleSet { roles: {} } uri = /vmms/e917287e-a0d9-4025-b75c-a5f9cb0524d2
67852024-11-19T02:22:13.798ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c1cd9a82-87c6-4afe-85fe-f18f25b0ffe4 resource = Database result = Ok(()) uri = /vmms/e917287e-a0d9-4025-b75c-a5f9cb0524d2
67862024-11-19T02:22:13.807ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = e917287e-a0d9-4025-b75c-a5f9cb0524d2 remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c1cd9a82-87c6-4afe-85fe-f18f25b0ffe4 uri = /vmms/e917287e-a0d9-4025-b75c-a5f9cb0524d2 vmm_needs_update = true
67872024-11-19T02:22:13.807ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c1cd9a82-87c6-4afe-85fe-f18f25b0ffe4 roles = RoleSet { roles: {} } uri = /vmms/e917287e-a0d9-4025-b75c-a5f9cb0524d2
67882024-11-19T02:22:13.807ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c1cd9a82-87c6-4afe-85fe-f18f25b0ffe4 resource = Database result = Ok(()) uri = /vmms/e917287e-a0d9-4025-b75c-a5f9cb0524d2
67892024-11-19T02:22:13.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c1cd9a82-87c6-4afe-85fe-f18f25b0ffe4 roles = RoleSet { roles: {} } uri = /vmms/e917287e-a0d9-4025-b75c-a5f9cb0524d2
67902024-11-19T02:22:13.810ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c1cd9a82-87c6-4afe-85fe-f18f25b0ffe4 resource = Database result = Ok(()) uri = /vmms/e917287e-a0d9-4025-b75c-a5f9cb0524d2
67912024-11-19T02:22:13.812ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c1cd9a82-87c6-4afe-85fe-f18f25b0ffe4 roles = RoleSet { roles: {} } uri = /vmms/e917287e-a0d9-4025-b75c-a5f9cb0524d2
67922024-11-19T02:22:13.812ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c1cd9a82-87c6-4afe-85fe-f18f25b0ffe4 resource = Database result = Ok(()) uri = /vmms/e917287e-a0d9-4025-b75c-a5f9cb0524d2
67932024-11-19T02:22:13.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c1cd9a82-87c6-4afe-85fe-f18f25b0ffe4 roles = RoleSet { roles: {} } uri = /vmms/e917287e-a0d9-4025-b75c-a5f9cb0524d2
67942024-11-19T02:22:13.817ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c1cd9a82-87c6-4afe-85fe-f18f25b0ffe4 resource = Database result = Ok(()) uri = /vmms/e917287e-a0d9-4025-b75c-a5f9cb0524d2
67952024-11-19T02:22:13.819ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c1cd9a82-87c6-4afe-85fe-f18f25b0ffe4 roles = RoleSet { roles: {} } uri = /vmms/e917287e-a0d9-4025-b75c-a5f9cb0524d2
67962024-11-19T02:22:13.819ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c1cd9a82-87c6-4afe-85fe-f18f25b0ffe4 resource = Database result = Ok(()) uri = /vmms/e917287e-a0d9-4025-b75c-a5f9cb0524d2
67972024-11-19T02:22:13.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c1cd9a82-87c6-4afe-85fe-f18f25b0ffe4 roles = RoleSet { roles: {} } uri = /vmms/e917287e-a0d9-4025-b75c-a5f9cb0524d2
67982024-11-19T02:22:13.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c1cd9a82-87c6-4afe-85fe-f18f25b0ffe4 resource = Database result = Ok(()) uri = /vmms/e917287e-a0d9-4025-b75c-a5f9cb0524d2
67992024-11-19T02:22:13.823ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c1cd9a82-87c6-4afe-85fe-f18f25b0ffe4 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/e917287e-a0d9-4025-b75c-a5f9cb0524d2
68002024-11-19T02:22:13.825ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c1cd9a82-87c6-4afe-85fe-f18f25b0ffe4 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 78638afa-e975-44a9-b764-0afec18d156f, lookup_type: ById(78638afa-e975-44a9-b764-0afec18d156f) }, key: 001a3915-439c-4a06-bc29-bf97442cc48c, lookup_type: ById(001a3915-439c-4a06-bc29-bf97442cc48c) }, key: e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947, lookup_type: ById(e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947) } result = Ok(()) uri = /vmms/e917287e-a0d9-4025-b75c-a5f9cb0524d2
68012024-11-19T02:22:13.828ZINFOnexus (dropshot_internal): starting update saga for e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1618 instance_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c1cd9a82-87c6-4afe-85fe-f18f25b0ffe4 uri = /vmms/e917287e-a0d9-4025-b75c-a5f9cb0524d2 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-19T02:22:13.797947680Z }
68022024-11-19T02:22:13.828ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30209 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c1cd9a82-87c6-4afe-85fe-f18f25b0ffe4 response_code = 204 uri = /vmms/e917287e-a0d9-4025-b75c-a5f9cb0524d2
68032024-11-19T02:22:13.828ZDEBGnexus (dropshot_internal): preparing instance-update saga for e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c1cd9a82-87c6-4afe-85fe-f18f25b0ffe4 uri = /vmms/e917287e-a0d9-4025-b75c-a5f9cb0524d2
68042024-11-19T02:22:13.828ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = b0f8f7f8-2673-4134-8b29-c23a2bdcef93 saga_name = start-instance-update
68052024-11-19T02:22:13.828ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947","lookup_type":{"ById":"e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947"},"parent":{"key":"001a3915-439c-4a06-bc29-bf97442cc48c","lookup_type":{"ById":"001a3915-439c-4a06-bc29-bf97442cc48c"},"parent":{"key":"78638afa-e975-44a9-b764-0afec18d156f","lookup_type":{"ById":"78638afa-e975-44a9-b764-0afec18d156f"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = b0f8f7f8-2673-4134-8b29-c23a2bdcef93 saga_name = start-instance-update sec_id = 9f0b435f-0000-451e-9dbc-dcec71543c30
68062024-11-19T02:22:13.828ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = b0f8f7f8-2673-4134-8b29-c23a2bdcef93 saga_name = start-instance-update
68072024-11-19T02:22:13.828ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = e917287e-a0d9-4025-b75c-a5f9cb0524d2 remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c339553f-8beb-4ee6-b252-ba5f249063e5 uri = /vmms/e917287e-a0d9-4025-b75c-a5f9cb0524d2 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-19T02:22:13.797947680Z }
68082024-11-19T02:22:13.828ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c339553f-8beb-4ee6-b252-ba5f249063e5 roles = RoleSet { roles: {} } uri = /vmms/e917287e-a0d9-4025-b75c-a5f9cb0524d2
68092024-11-19T02:22:13.829ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c339553f-8beb-4ee6-b252-ba5f249063e5 resource = Database result = Ok(()) uri = /vmms/e917287e-a0d9-4025-b75c-a5f9cb0524d2
68102024-11-19T02:22:13.836ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7331 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c339553f-8beb-4ee6-b252-ba5f249063e5 response_code = 204 uri = /vmms/e917287e-a0d9-4025-b75c-a5f9cb0524d2
68112024-11-19T02:22:13.860ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = b0f8f7f8-2673-4134-8b29-c23a2bdcef93 saga_name = start-instance-update
68122024-11-19T02:22:13.860ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = b0f8f7f8-2673-4134-8b29-c23a2bdcef93 saga_name = start-instance-update sec_id = 9f0b435f-0000-451e-9dbc-dcec71543c30
68132024-11-19T02:22:13.860ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 9f0b435f-0000-451e-9dbc-dcec71543c30
68142024-11-19T02:22:13.860ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = b0f8f7f8-2673-4134-8b29-c23a2bdcef93
68152024-11-19T02:22:13.864ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 9f0b435f-0000-451e-9dbc-dcec71543c30
68162024-11-19T02:22:13.864ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = b0f8f7f8-2673-4134-8b29-c23a2bdcef93
68172024-11-19T02:22:13.867ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 9f0b435f-0000-451e-9dbc-dcec71543c30
68182024-11-19T02:22:13.867ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = b0f8f7f8-2673-4134-8b29-c23a2bdcef93
68192024-11-19T02:22:13.871ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 9f0b435f-0000-451e-9dbc-dcec71543c30
68202024-11-19T02:22:13.871ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("2d321f8e-afb6-4b27-ac92-9d4d517a765f")) node_id = 0 saga_id = b0f8f7f8-2673-4134-8b29-c23a2bdcef93
68212024-11-19T02:22:13.874ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 9f0b435f-0000-451e-9dbc-dcec71543c30
68222024-11-19T02:22:13.874ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = b0f8f7f8-2673-4134-8b29-c23a2bdcef93
68232024-11-19T02:22:13.880ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 saga_id = b0f8f7f8-2673-4134-8b29-c23a2bdcef93 saga_name = start-instance-update
68242024-11-19T02:22:13.880ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b0f8f7f8-2673-4134-8b29-c23a2bdcef93 saga_name = start-instance-update saga_node = LockInstance
68252024-11-19T02:22:13.880ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b0f8f7f8-2673-4134-8b29-c23a2bdcef93 saga_name = start-instance-update saga_node = LockInstance
68262024-11-19T02:22:13.881ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b0f8f7f8-2673-4134-8b29-c23a2bdcef93 saga_name = start-instance-update saga_node = LockInstance
68272024-11-19T02:22:13.882ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b0f8f7f8-2673-4134-8b29-c23a2bdcef93 saga_name = start-instance-update saga_node = LockInstance
68282024-11-19T02:22:13.884ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b0f8f7f8-2673-4134-8b29-c23a2bdcef93 saga_name = start-instance-update saga_node = LockInstance
68292024-11-19T02:22:13.884ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b0f8f7f8-2673-4134-8b29-c23a2bdcef93 saga_name = start-instance-update saga_node = LockInstance
68302024-11-19T02:22:13.886ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b0f8f7f8-2673-4134-8b29-c23a2bdcef93 saga_name = start-instance-update saga_node = LockInstance
68312024-11-19T02:22:13.886ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b0f8f7f8-2673-4134-8b29-c23a2bdcef93 saga_name = start-instance-update saga_node = LockInstance
68322024-11-19T02:22:13.887ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b0f8f7f8-2673-4134-8b29-c23a2bdcef93 saga_name = start-instance-update saga_node = LockInstance
68332024-11-19T02:22:13.887ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b0f8f7f8-2673-4134-8b29-c23a2bdcef93 saga_name = start-instance-update saga_node = LockInstance
68342024-11-19T02:22:13.888ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b0f8f7f8-2673-4134-8b29-c23a2bdcef93 saga_name = start-instance-update saga_node = LockInstance
68352024-11-19T02:22:13.888ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b0f8f7f8-2673-4134-8b29-c23a2bdcef93 saga_name = start-instance-update saga_node = LockInstance
68362024-11-19T02:22:13.890ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = b0f8f7f8-2673-4134-8b29-c23a2bdcef93 saga_name = start-instance-update saga_node = LockInstance
68372024-11-19T02:22:13.895ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 78638afa-e975-44a9-b764-0afec18d156f, lookup_type: ById(78638afa-e975-44a9-b764-0afec18d156f) }, key: 001a3915-439c-4a06-bc29-bf97442cc48c, lookup_type: ById(001a3915-439c-4a06-bc29-bf97442cc48c) }, key: e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947, lookup_type: ById(e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947) } result = Ok(()) saga_id = b0f8f7f8-2673-4134-8b29-c23a2bdcef93 saga_name = start-instance-update saga_node = LockInstance
68382024-11-19T02:22:13.895ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 saga_id = b0f8f7f8-2673-4134-8b29-c23a2bdcef93 saga_name = start-instance-update saga_node = LockInstance updater_id = 2d321f8e-afb6-4b27-ac92-9d4d517a765f
68392024-11-19T02:22:13.895ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b0f8f7f8-2673-4134-8b29-c23a2bdcef93 saga_name = start-instance-update saga_node = LockInstance
68402024-11-19T02:22:13.896ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b0f8f7f8-2673-4134-8b29-c23a2bdcef93 saga_name = start-instance-update saga_node = LockInstance
68412024-11-19T02:22:13.905ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 saga_id = b0f8f7f8-2673-4134-8b29-c23a2bdcef93 saga_name = start-instance-update saga_node = LockInstance updater_id = 2d321f8e-afb6-4b27-ac92-9d4d517a765f
68422024-11-19T02:22:13.905ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b0f8f7f8-2673-4134-8b29-c23a2bdcef93 saga_name = start-instance-update saga_node = LockInstance
68432024-11-19T02:22:13.906ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b0f8f7f8-2673-4134-8b29-c23a2bdcef93 saga_name = start-instance-update saga_node = LockInstance
68442024-11-19T02:22:13.913ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 locked_gen = Generation(Generation(2)) saga_id = b0f8f7f8-2673-4134-8b29-c23a2bdcef93 saga_name = start-instance-update saga_node = LockInstance updater_id = 2d321f8e-afb6-4b27-ac92-9d4d517a765f
68452024-11-19T02:22:13.913ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 9f0b435f-0000-451e-9dbc-dcec71543c30
68462024-11-19T02:22:13.913ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("2d321f8e-afb6-4b27-ac92-9d4d517a765f")}) node_id = 1 saga_id = b0f8f7f8-2673-4134-8b29-c23a2bdcef93
68472024-11-19T02:22:13.916ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 9f0b435f-0000-451e-9dbc-dcec71543c30
68482024-11-19T02:22:13.916ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = b0f8f7f8-2673-4134-8b29-c23a2bdcef93
68492024-11-19T02:22:13.920ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b0f8f7f8-2673-4134-8b29-c23a2bdcef93 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
68502024-11-19T02:22:13.920ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b0f8f7f8-2673-4134-8b29-c23a2bdcef93 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
68512024-11-19T02:22:13.921ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b0f8f7f8-2673-4134-8b29-c23a2bdcef93 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
68522024-11-19T02:22:13.922ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b0f8f7f8-2673-4134-8b29-c23a2bdcef93 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
68532024-11-19T02:22:13.923ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b0f8f7f8-2673-4134-8b29-c23a2bdcef93 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
68542024-11-19T02:22:13.923ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b0f8f7f8-2673-4134-8b29-c23a2bdcef93 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
68552024-11-19T02:22:13.925ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = b0f8f7f8-2673-4134-8b29-c23a2bdcef93 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
68562024-11-19T02:22:13.928ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 78638afa-e975-44a9-b764-0afec18d156f, lookup_type: ById(78638afa-e975-44a9-b764-0afec18d156f) }, key: 001a3915-439c-4a06-bc29-bf97442cc48c, lookup_type: ById(001a3915-439c-4a06-bc29-bf97442cc48c) }, key: e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947, lookup_type: ById(e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947) } result = Ok(()) saga_id = b0f8f7f8-2673-4134-8b29-c23a2bdcef93 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
68572024-11-19T02:22:13.928ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b0f8f7f8-2673-4134-8b29-c23a2bdcef93 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
68582024-11-19T02:22:13.928ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b0f8f7f8-2673-4134-8b29-c23a2bdcef93 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
68592024-11-19T02:22:13.936ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: e917287e-a0d9-4025-b75c-a5f9cb0524d2, time_created: 2024-11-19T02:21:53.022255Z, time_deleted: None, instance_id: e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947, sled_id: ffe74824-0c08-48e1-a755-fb123e8dc181, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-11-19T02:22:13.797947Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-11-19T02:21:50.837784Z, gen: Generation(Generation(3)), propolis_id: Some(e917287e-a0d9-4025-b75c-a5f9cb0524d2), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 saga_id = b0f8f7f8-2673-4134-8b29-c23a2bdcef93 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(e917287e-a0d9-4025-b75c-a5f9cb0524d2 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-11-19T02:22:13.936192942Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
68602024-11-19T02:22:13.938ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2 saga_name = instance-update
68612024-11-19T02:22:13.938ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"e917287e-a0d9-4025-b75c-a5f9cb0524d2"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947","lookup_type":{"ById":"e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947"},"parent":{"key":"001a3915-439c-4a06-bc29-bf97442cc48c","lookup_type":{"ById":"001a3915-439c-4a06-bc29-bf97442cc48c"},"parent":{"key":"78638afa-e975-44a9-b764-0afec18d156f","lookup_type":{"ById":"78638afa-e975-44a9-b764-0afec18d156f"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"2d321f8e-afb6-4b27-ac92-9d4d517a765f"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"001a3915-439c-4a06-bc29-bf97442cc48c","ram_diff":1073741824},"destroy_active_vmm":"e917287e-a0d9-4025-b75c-a5f9cb0524d2","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2024-11-19T02:22:13.936192942Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2 saga_name = instance-update sec_id = 9f0b435f-0000-451e-9dbc-dcec71543c30
68622024-11-19T02:22:13.938ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2 saga_name = instance-update
68632024-11-19T02:22:13.969ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2 saga_name = instance-update
68642024-11-19T02:22:13.969ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2 saga_name = instance-update sec_id = 9f0b435f-0000-451e-9dbc-dcec71543c30
68652024-11-19T02:22:13.969ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 9f0b435f-0000-451e-9dbc-dcec71543c30
68662024-11-19T02:22:13.969ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2
68672024-11-19T02:22:13.972ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 9f0b435f-0000-451e-9dbc-dcec71543c30
68682024-11-19T02:22:13.972ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2
68692024-11-19T02:22:13.975ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 9f0b435f-0000-451e-9dbc-dcec71543c30
68702024-11-19T02:22:13.975ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2
68712024-11-19T02:22:13.979ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 9f0b435f-0000-451e-9dbc-dcec71543c30
68722024-11-19T02:22:13.979ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("611f4f24-5c58-4545-b03c-83e0d21193a1")) node_id = 0 saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2
68732024-11-19T02:22:13.983ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 9f0b435f-0000-451e-9dbc-dcec71543c30
68742024-11-19T02:22:13.983ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2
68752024-11-19T02:22:13.991ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 parent_lock = UpdaterLock { updater_id: 2d321f8e-afb6-4b27-ac92-9d4d517a765f, locked_gen: Generation(Generation(2)) } saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2 saga_name = instance-update
68762024-11-19T02:22:13.991ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2 saga_name = instance-update saga_node = BecomeUpdater
68772024-11-19T02:22:13.992ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2 saga_name = instance-update saga_node = BecomeUpdater
68782024-11-19T02:22:14.001ZDEBGnexus (SagaExecutor): inherited lock from 2d321f8e-afb6-4b27-ac92-9d4d517a765f to 611f4f24-5c58-4545-b03c-83e0d21193a1 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = 2d321f8e-afb6-4b27-ac92-9d4d517a765f saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2 saga_name = instance-update saga_node = BecomeUpdater updater_id = 611f4f24-5c58-4545-b03c-83e0d21193a1
68792024-11-19T02:22:14.001ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2 saga_name = instance-update
68802024-11-19T02:22:14.001ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 9f0b435f-0000-451e-9dbc-dcec71543c30
68812024-11-19T02:22:14.001ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("611f4f24-5c58-4545-b03c-83e0d21193a1")}) node_id = 1 saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2
68822024-11-19T02:22:14.004ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 9f0b435f-0000-451e-9dbc-dcec71543c30
68832024-11-19T02:22:14.004ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2
68842024-11-19T02:22:14.007ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 9f0b435f-0000-451e-9dbc-dcec71543c30
68852024-11-19T02:22:14.007ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2
68862024-11-19T02:22:14.010ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 9f0b435f-0000-451e-9dbc-dcec71543c30
68872024-11-19T02:22:14.010ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2
68882024-11-19T02:22:14.016ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2 saga_name = instance-update
68892024-11-19T02:22:14.018ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947
68902024-11-19T02:22:14.021ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2 saga_name = instance-update saga_node = UpdateNetworkConfig
68912024-11-19T02:22:14.021ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2 saga_name = instance-update saga_node = UpdateNetworkConfig
68922024-11-19T02:22:14.023ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2 saga_name = instance-update saga_node = UpdateNetworkConfig
68932024-11-19T02:22:14.024ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2 saga_name = instance-update saga_node = UpdateNetworkConfig
68942024-11-19T02:22:14.025ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
68952024-11-19T02:22:14.025ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2 saga_name = instance-update saga_node = UpdateNetworkConfig
68962024-11-19T02:22:14.025ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2 saga_name = instance-update saga_node = UpdateNetworkConfig
68972024-11-19T02:22:14.027ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
68982024-11-19T02:22:14.027ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
68992024-11-19T02:22:14.027ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
69002024-11-19T02:22:14.029ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
69012024-11-19T02:22:14.030ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
69022024-11-19T02:22:14.030ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
69032024-11-19T02:22:14.030ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
69042024-11-19T02:22:14.034ZDEBGnexus: notifying dendrite of updates instance_id = Some(e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 (instance)) switch = switch0
69052024-11-19T02:22:14.034ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1631, tv_nsec: 817515417 } })
69062024-11-19T02:22:14.034ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1131
69072024-11-19T02:22:14.064ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
69082024-11-19T02:22:14.065ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
69092024-11-19T02:22:14.065ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e075fa5d-37f0-44aa-b304-6fc4c79c8561", "content-length": "26", "date": "Tue, 19 Nov 2024 02:22:14 GMT"} })
69102024-11-19T02:22:14.065ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
69112024-11-19T02:22:14.065ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
69122024-11-19T02:22:14.094ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
69132024-11-19T02:22:14.095ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "94b33460-4f4e-4f03-8e8d-16b9c9ec2f53", "content-length": "4", "date": "Tue, 19 Nov 2024 02:22:13 GMT"} })
69142024-11-19T02:22:14.096ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 9f0b435f-0000-451e-9dbc-dcec71543c30
69152024-11-19T02:22:14.096ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2
69162024-11-19T02:22:14.100ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 9f0b435f-0000-451e-9dbc-dcec71543c30
69172024-11-19T02:22:14.100ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2
69182024-11-19T02:22:14.105ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
69192024-11-19T02:22:14.106ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
69202024-11-19T02:22:14.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = 2b279d7b-f825-4bc5-91d9-dec44152c55e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
69212024-11-19T02:22:14.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = 2b279d7b-f825-4bc5-91d9-dec44152c55e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
69222024-11-19T02:22:14.181ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3207 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = 2b279d7b-f825-4bc5-91d9-dec44152c55e response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
69232024-11-19T02:22:14.182ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 records_deleted = [VirtualProvisioningCollection { id: 001a3915-439c-4a06-bc29-bf97442cc48c, time_modified: Some(2024-11-19T02:22:14.109107Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-11-19T02:22:14.109107Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 78638afa-e975-44a9-b764-0afec18d156f, time_modified: Some(2024-11-19T02:22:14.109107Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2 saga_name = instance-update
69242024-11-19T02:22:14.182ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 9f0b435f-0000-451e-9dbc-dcec71543c30
69252024-11-19T02:22:14.182ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2
69262024-11-19T02:22:14.186ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 9f0b435f-0000-451e-9dbc-dcec71543c30
69272024-11-19T02:22:14.186ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2
69282024-11-19T02:22:14.190ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2 saga_name = instance-update
69292024-11-19T02:22:14.193ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2 saga_name = instance-update saga_node = UnassignOximeterProducer
69302024-11-19T02:22:14.193ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2 saga_name = instance-update saga_node = UnassignOximeterProducer
69312024-11-19T02:22:14.197ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = 3980dd20-a3be-40d3-b9e5-094b8ed4b785 producer_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2 saga_name = instance-update
69322024-11-19T02:22:14.197ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2 saga_name = instance-update saga_node = UnassignOximeterProducer
69332024-11-19T02:22:14.198ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2 saga_name = instance-update saga_node = UnassignOximeterProducer
69342024-11-19T02:22:14.231ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2 saga_name = instance-update
69352024-11-19T02:22:14.237ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947
69362024-11-19T02:22:14.251ZDEBGnexus (SagaExecutor): client response oximeter-collector = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947", status: 204, headers: {"x-request-id": "a3035e45-1ace-4d2f-84c9-034ec05b18ad", "date": "Tue, 19 Nov 2024 02:22:14 GMT"} }) saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2 saga_name = instance-update
69372024-11-19T02:22:14.251ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = 3980dd20-a3be-40d3-b9e5-094b8ed4b785 producer_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2 saga_name = instance-update
69382024-11-19T02:22:14.252ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 9f0b435f-0000-451e-9dbc-dcec71543c30
69392024-11-19T02:22:14.252ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2
69402024-11-19T02:22:14.255ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 9f0b435f-0000-451e-9dbc-dcec71543c30
69412024-11-19T02:22:14.255ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2
69422024-11-19T02:22:14.258ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 lock = UpdaterLock { updater_id: 611f4f24-5c58-4545-b03c-83e0d21193a1, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-11-19T02:22:13.936192942Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2 saga_name = instance-update
69432024-11-19T02:22:14.258ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2 saga_name = instance-update saga_node = CommitInstanceUpdates
69442024-11-19T02:22:14.259ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2 saga_name = instance-update saga_node = CommitInstanceUpdates
69452024-11-19T02:22:14.299ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 new_runtime = InstanceRuntimeState { time_updated: 2024-11-19T02:22:13.936192942Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2 saga_name = instance-update
69462024-11-19T02:22:14.299ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 9f0b435f-0000-451e-9dbc-dcec71543c30
69472024-11-19T02:22:14.299ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2
69482024-11-19T02:22:14.299ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Signaled
69492024-11-19T02:22:14.299ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Signaled
69502024-11-19T02:22:14.299ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
69512024-11-19T02:22:14.299ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69522024-11-19T02:22:14.299ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69532024-11-19T02:22:14.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69542024-11-19T02:22:14.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69552024-11-19T02:22:14.302ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69562024-11-19T02:22:14.303ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 9f0b435f-0000-451e-9dbc-dcec71543c30
69572024-11-19T02:22:14.303ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2
69582024-11-19T02:22:14.303ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
69592024-11-19T02:22:14.303ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69602024-11-19T02:22:14.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69612024-11-19T02:22:14.305ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69622024-11-19T02:22:14.307ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 9f0b435f-0000-451e-9dbc-dcec71543c30
69632024-11-19T02:22:14.307ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("e917287e-a0d9-4025-b75c-a5f9cb0524d2")}) node_id = 7 saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2
69642024-11-19T02:22:14.307ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
69652024-11-19T02:22:14.307ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69662024-11-19T02:22:14.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69672024-11-19T02:22:14.310ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 9f0b435f-0000-451e-9dbc-dcec71543c30
69682024-11-19T02:22:14.310ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2
69692024-11-19T02:22:14.313ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 9f0b435f-0000-451e-9dbc-dcec71543c30
69702024-11-19T02:22:14.313ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2
69712024-11-19T02:22:14.316ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 9f0b435f-0000-451e-9dbc-dcec71543c30
69722024-11-19T02:22:14.316ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2
69732024-11-19T02:22:14.323ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 propolis_id = e917287e-a0d9-4025-b75c-a5f9cb0524d2 saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2 saga_name = instance-update
69742024-11-19T02:22:14.323ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2 saga_name = instance-update saga_node = ReleaseSledResources
69752024-11-19T02:22:14.323ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2 saga_name = instance-update saga_node = ReleaseSledResources
69762024-11-19T02:22:14.326ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 9f0b435f-0000-451e-9dbc-dcec71543c30
69772024-11-19T02:22:14.326ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2
69782024-11-19T02:22:14.329ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 29192818-e888-465b-b54e-243f2cc627c5 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
69792024-11-19T02:22:14.329ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 29192818-e888-465b-b54e-243f2cc627c5 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
69802024-11-19T02:22:14.330ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1792 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 29192818-e888-465b-b54e-243f2cc627c5 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
69812024-11-19T02:22:14.331ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 9f0b435f-0000-451e-9dbc-dcec71543c30
69822024-11-19T02:22:14.331ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2
69832024-11-19T02:22:14.334ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 propolis_id = e917287e-a0d9-4025-b75c-a5f9cb0524d2 saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2 saga_name = instance-update
69842024-11-19T02:22:14.334ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2 saga_name = instance-update saga_node = MarkVmmDeleted
69852024-11-19T02:22:14.334ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2 saga_name = instance-update saga_node = MarkVmmDeleted
69862024-11-19T02:22:14.342ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 9f0b435f-0000-451e-9dbc-dcec71543c30
69872024-11-19T02:22:14.342ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2
69882024-11-19T02:22:14.346ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 9f0b435f-0000-451e-9dbc-dcec71543c30
69892024-11-19T02:22:14.346ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2
69902024-11-19T02:22:14.349ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 9f0b435f-0000-451e-9dbc-dcec71543c30
69912024-11-19T02:22:14.349ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2
69922024-11-19T02:22:14.351ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 9f0b435f-0000-451e-9dbc-dcec71543c30
69932024-11-19T02:22:14.351ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2
69942024-11-19T02:22:14.355ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2 saga_name = instance-update saga_node = ChainSuccessorSaga
69952024-11-19T02:22:14.355ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2 saga_name = instance-update saga_node = ChainSuccessorSaga
69962024-11-19T02:22:14.357ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2 saga_name = instance-update saga_node = ChainSuccessorSaga
69972024-11-19T02:22:14.357ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2 saga_name = instance-update saga_node = ChainSuccessorSaga
69982024-11-19T02:22:14.358ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2 saga_name = instance-update saga_node = ChainSuccessorSaga
69992024-11-19T02:22:14.359ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2 saga_name = instance-update saga_node = ChainSuccessorSaga
70002024-11-19T02:22:14.360ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2 saga_name = instance-update saga_node = ChainSuccessorSaga
70012024-11-19T02:22:14.363ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 78638afa-e975-44a9-b764-0afec18d156f, lookup_type: ById(78638afa-e975-44a9-b764-0afec18d156f) }, key: 001a3915-439c-4a06-bc29-bf97442cc48c, lookup_type: ById(001a3915-439c-4a06-bc29-bf97442cc48c) }, key: e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947, lookup_type: ById(e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947) } result = Ok(()) saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2 saga_name = instance-update saga_node = ChainSuccessorSaga
70022024-11-19T02:22:14.363ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2 saga_name = instance-update saga_node = ChainSuccessorSaga
70032024-11-19T02:22:14.363ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2 saga_name = instance-update saga_node = ChainSuccessorSaga
70042024-11-19T02:22:14.366ZDEBGnexus (SagaExecutor): instance update: instance will not reincarnate auto_restart_config = InstanceAutoRestart { policy: None, cooldown: None } instance_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 karmic_state = WillReincarnate needs_reincarnation = false saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2 saga_name = instance-update
70052024-11-19T02:22:14.366ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 9f0b435f-0000-451e-9dbc-dcec71543c30
70062024-11-19T02:22:14.366ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2
70072024-11-19T02:22:14.370ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 9f0b435f-0000-451e-9dbc-dcec71543c30
70082024-11-19T02:22:14.370ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2
70092024-11-19T02:22:14.373ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 9f0b435f-0000-451e-9dbc-dcec71543c30
70102024-11-19T02:22:14.373ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2
70112024-11-19T02:22:14.376ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2 sec_id = 9f0b435f-0000-451e-9dbc-dcec71543c30
70122024-11-19T02:22:14.376ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2
70132024-11-19T02:22:14.401ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70142024-11-19T02:22:14.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70152024-11-19T02:22:14.402ZINFOnexus (BackgroundTasks): VPC route manager sled ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
70162024-11-19T02:22:14.402ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
70172024-11-19T02:22:14.402ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b573580c-8457-42c0-8c9f-747b27528466", "content-length": "372", "date": "Tue, 19 Nov 2024 02:22:14 GMT"} })
70182024-11-19T02:22:14.402ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70192024-11-19T02:22:14.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70202024-11-19T02:22:14.410ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70212024-11-19T02:22:14.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70222024-11-19T02:22:14.412ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70232024-11-19T02:22:14.413ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
70242024-11-19T02:22:14.414ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70252024-11-19T02:22:14.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70262024-11-19T02:22:14.415ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70272024-11-19T02:22:14.416ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
70282024-11-19T02:22:14.416ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
70292024-11-19T02:22:14.417ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "66760ab5-976c-45ae-a684-ccca7dbbeb87", "date": "Tue, 19 Nov 2024 02:22:14 GMT"} })
70302024-11-19T02:22:14.417ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70312024-11-19T02:22:14.417ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
70322024-11-19T02:22:14.417ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70332024-11-19T02:22:14.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70342024-11-19T02:22:14.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70352024-11-19T02:22:14.418ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70362024-11-19T02:22:14.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70372024-11-19T02:22:14.421ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70382024-11-19T02:22:14.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70392024-11-19T02:22:14.424ZINFOnexus (BackgroundTasks): VPC route manager sled ffe74824-0c08-48e1-a755-fb123e8dc181 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
70402024-11-19T02:22:14.424ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
70412024-11-19T02:22:14.435ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2 saga_name = instance-update sec_id = 9f0b435f-0000-451e-9dbc-dcec71543c30
70422024-11-19T02:22:14.435ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2 saga_name = instance-update saga_result = SagaResult { saga_id: e540e63f-cd24-44cd-bf51-84c10fc9f5f2, saga_log: SagaLog { saga_id: e540e63f-cd24-44cd-bf51-84c10fc9f5f2, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("611f4f24-5c58-4545-b03c-83e0d21193a1")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("611f4f24-5c58-4545-b03c-83e0d21193a1")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("e917287e-a0d9-4025-b75c-a5f9cb0524d2")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("e917287e-a0d9-4025-b75c-a5f9cb0524d2")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("611f4f24-5c58-4545-b03c-83e0d21193a1"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("611f4f24-5c58-4545-b03c-83e0d21193a1")}} }) }
70432024-11-19T02:22:14.435ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = e540e63f-cd24-44cd-bf51-84c10fc9f5f2 instance_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 saga_id = b0f8f7f8-2673-4134-8b29-c23a2bdcef93 saga_name = start-instance-update
70442024-11-19T02:22:14.435ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 9f0b435f-0000-451e-9dbc-dcec71543c30
70452024-11-19T02:22:14.435ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = b0f8f7f8-2673-4134-8b29-c23a2bdcef93
70462024-11-19T02:22:14.438ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 9f0b435f-0000-451e-9dbc-dcec71543c30
70472024-11-19T02:22:14.438ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = b0f8f7f8-2673-4134-8b29-c23a2bdcef93
70482024-11-19T02:22:14.441ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 9f0b435f-0000-451e-9dbc-dcec71543c30
70492024-11-19T02:22:14.441ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = b0f8f7f8-2673-4134-8b29-c23a2bdcef93
70502024-11-19T02:22:14.444ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:57350
70512024-11-19T02:22:14.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:57350 req_id = 8e98ce24-6831-4f64-b93b-afac46897c1c roles = RoleSet { roles: {} } uri = /metrics/producers
70522024-11-19T02:22:14.444ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:57350 req_id = 8e98ce24-6831-4f64-b93b-afac46897c1c resource = Database result = Ok(()) uri = /metrics/producers
70532024-11-19T02:22:14.451ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
70542024-11-19T02:22:14.454ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = b0f8f7f8-2673-4134-8b29-c23a2bdcef93 sec_id = 9f0b435f-0000-451e-9dbc-dcec71543c30
70552024-11-19T02:22:14.454ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = b0f8f7f8-2673-4134-8b29-c23a2bdcef93
70562024-11-19T02:22:14.455ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:58944
70572024-11-19T02:22:14.456ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:58944 req_id = 02f3557f-c306-4788-90ee-fb5726f41f89 roles = RoleSet { roles: {} } uri = /metrics/producers
70582024-11-19T02:22:14.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:58944 req_id = 02f3557f-c306-4788-90ee-fb5726f41f89 resource = Database result = Ok(()) uri = /metrics/producers
70592024-11-19T02:22:14.456ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b56587a-1a08-49a0-80ce-d769a7c899ce", "content-length": "691", "date": "Tue, 19 Nov 2024 02:22:14 GMT"} })
70602024-11-19T02:22:14.456ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "5601cdc4-c365-41ac-83ed-bfa089e95839", "date": "Tue, 19 Nov 2024 02:22:14 GMT"} })
70612024-11-19T02:22:14.456ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
70622024-11-19T02:22:14.456ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
70632024-11-19T02:22:14.456ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
70642024-11-19T02:22:14.458ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 158.472774ms iteration = 27 status = {}
70652024-11-19T02:22:14.458ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 158.591865ms iteration = 26 status = {}
70662024-11-19T02:22:14.464ZINFOnexus: assigned collector to new producer collector_id = 3980dd20-a3be-40d3-b9e5-094b8ed4b785 file = nexus/src/app/oximeter.rs:76 producer_id = ffe74824-0c08-48e1-a755-fb123e8dc181
70672024-11-19T02:22:14.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8296 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:58944 req_id = 02f3557f-c306-4788-90ee-fb5726f41f89 response_code = 201 uri = /metrics/producers
70682024-11-19T02:22:14.486ZINFOnexus: assigned collector to new producer collector_id = 3980dd20-a3be-40d3-b9e5-094b8ed4b785 file = nexus/src/app/oximeter.rs:76 producer_id = 4531e85d-d56a-4e09-b4e5-16020bc21701
70692024-11-19T02:22:14.486ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42633 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:57350 req_id = 8e98ce24-6831-4f64-b93b-afac46897c1c response_code = 201 uri = /metrics/producers
70702024-11-19T02:22:14.489ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = b0f8f7f8-2673-4134-8b29-c23a2bdcef93 saga_name = start-instance-update sec_id = 9f0b435f-0000-451e-9dbc-dcec71543c30
70712024-11-19T02:22:14.489ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = b0f8f7f8-2673-4134-8b29-c23a2bdcef93 saga_name = start-instance-update saga_result = SagaResult { saga_id: b0f8f7f8-2673-4134-8b29-c23a2bdcef93, saga_log: SagaLog { saga_id: b0f8f7f8-2673-4134-8b29-c23a2bdcef93, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("2d321f8e-afb6-4b27-ac92-9d4d517a765f")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("2d321f8e-afb6-4b27-ac92-9d4d517a765f")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("2d321f8e-afb6-4b27-ac92-9d4d517a765f"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("2d321f8e-afb6-4b27-ac92-9d4d517a765f")}} }) }
70722024-11-19T02:22:15.112ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:37019
70732024-11-19T02:22:15.112ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:37019 req_id = 2d41d6da-cb39-49da-8b0a-4a098f60f357 roles = RoleSet { roles: {} } uri = /metrics/producers
70742024-11-19T02:22:15.112ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:37019 req_id = 2d41d6da-cb39-49da-8b0a-4a098f60f357 resource = Database result = Ok(()) uri = /metrics/producers
70752024-11-19T02:22:15.150ZINFOnexus: assigned collector to new producer collector_id = 3980dd20-a3be-40d3-b9e5-094b8ed4b785 file = nexus/src/app/oximeter.rs:76 producer_id = cd87c155-df14-4737-bbdc-04963164d701
70762024-11-19T02:22:15.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38310 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:37019 req_id = 2d41d6da-cb39-49da-8b0a-4a098f60f357 response_code = 201 uri = /metrics/producers
70772024-11-19T02:22:15.354ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 71e384f1-d5f4-41aa-b7ca-2e41233f9fd1 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
70782024-11-19T02:22:15.354ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 71e384f1-d5f4-41aa-b7ca-2e41233f9fd1 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
70792024-11-19T02:22:15.356ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1950 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 71e384f1-d5f4-41aa-b7ca-2e41233f9fd1 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
70802024-11-19T02:22:15.726ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
70812024-11-19T02:22:15.726ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
70822024-11-19T02:22:15.726ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
70832024-11-19T02:22:15.726ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
70842024-11-19T02:22:15.726ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
70852024-11-19T02:22:15.726ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70862024-11-19T02:22:15.726ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
70872024-11-19T02:22:15.726ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70882024-11-19T02:22:15.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
70892024-11-19T02:22:15.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
70902024-11-19T02:22:15.726ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
70912024-11-19T02:22:15.726ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
70922024-11-19T02:22:15.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
70932024-11-19T02:22:15.726ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
70942024-11-19T02:22:15.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70952024-11-19T02:22:15.727ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
70962024-11-19T02:22:15.727ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
70972024-11-19T02:22:15.727ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
70982024-11-19T02:22:15.727ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
70992024-11-19T02:22:15.727ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
71002024-11-19T02:22:15.727ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71012024-11-19T02:22:15.727ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
71022024-11-19T02:22:15.727ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
71032024-11-19T02:22:15.727ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
71042024-11-19T02:22:15.727ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
71052024-11-19T02:22:15.727ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
71062024-11-19T02:22:15.727ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71072024-11-19T02:22:15.727ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
71082024-11-19T02:22:15.727ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71092024-11-19T02:22:15.727ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
71102024-11-19T02:22:15.727ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71112024-11-19T02:22:15.727ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
71122024-11-19T02:22:15.727ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
71132024-11-19T02:22:15.727ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
71142024-11-19T02:22:15.727ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
71152024-11-19T02:22:15.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
71162024-11-19T02:22:15.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
71172024-11-19T02:22:15.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71182024-11-19T02:22:15.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71192024-11-19T02:22:15.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71202024-11-19T02:22:15.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
71212024-11-19T02:22:15.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
71222024-11-19T02:22:15.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
71232024-11-19T02:22:15.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
71242024-11-19T02:22:15.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
71252024-11-19T02:22:15.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
71262024-11-19T02:22:15.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71272024-11-19T02:22:15.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71282024-11-19T02:22:15.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71292024-11-19T02:22:15.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71302024-11-19T02:22:15.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
71312024-11-19T02:22:15.729ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1633, tv_nsec: 512154633 } })
71322024-11-19T02:22:15.729ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
71332024-11-19T02:22:15.729ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1633, tv_nsec: 512726340 } })
71342024-11-19T02:22:15.729ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71352024-11-19T02:22:15.730ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
71362024-11-19T02:22:15.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71372024-11-19T02:22:15.730ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.715952ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
71382024-11-19T02:22:15.730ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71392024-11-19T02:22:15.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
71402024-11-19T02:22:15.733ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71412024-11-19T02:22:15.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71422024-11-19T02:22:15.733ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
71432024-11-19T02:22:15.733ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
71442024-11-19T02:22:15.733ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
71452024-11-19T02:22:15.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
71462024-11-19T02:22:15.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
71472024-11-19T02:22:15.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71482024-11-19T02:22:15.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
71492024-11-19T02:22:15.734ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71502024-11-19T02:22:15.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71512024-11-19T02:22:15.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71522024-11-19T02:22:15.735ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
71532024-11-19T02:22:15.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
71542024-11-19T02:22:15.736ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.304266ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
71552024-11-19T02:22:15.737ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71562024-11-19T02:22:15.737ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71572024-11-19T02:22:15.738ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71582024-11-19T02:22:15.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
71592024-11-19T02:22:15.740ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
71602024-11-19T02:22:15.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
71612024-11-19T02:22:15.740ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
71622024-11-19T02:22:15.740ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71632024-11-19T02:22:15.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
71642024-11-19T02:22:15.740ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71652024-11-19T02:22:15.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71662024-11-19T02:22:15.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71672024-11-19T02:22:15.741ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
71682024-11-19T02:22:15.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
71692024-11-19T02:22:15.743ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71702024-11-19T02:22:15.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71712024-11-19T02:22:15.743ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1633, tv_nsec: 526842352 } })
71722024-11-19T02:22:15.744ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
71732024-11-19T02:22:15.744ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71742024-11-19T02:22:15.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71752024-11-19T02:22:15.744ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71762024-11-19T02:22:15.745ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71772024-11-19T02:22:15.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71782024-11-19T02:22:15.746ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71792024-11-19T02:22:15.747ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71802024-11-19T02:22:15.747ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
71812024-11-19T02:22:15.747ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71822024-11-19T02:22:15.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71832024-11-19T02:22:15.749ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
71842024-11-19T02:22:15.749ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71852024-11-19T02:22:15.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71862024-11-19T02:22:15.751ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
71872024-11-19T02:22:15.751ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71882024-11-19T02:22:15.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71892024-11-19T02:22:15.765ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
71902024-11-19T02:22:15.765ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 38.241708ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
71912024-11-19T02:22:15.766ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 39.638044ms iteration = 26 status = {"errors":[],"records_set_to_done":[]}
71922024-11-19T02:22:15.768ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71932024-11-19T02:22:15.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71942024-11-19T02:22:15.769ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
71952024-11-19T02:22:15.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
71962024-11-19T02:22:15.770ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71972024-11-19T02:22:15.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71982024-11-19T02:22:15.772ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71992024-11-19T02:22:15.772ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
72002024-11-19T02:22:15.772ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
72012024-11-19T02:22:15.772ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
72022024-11-19T02:22:15.772ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72032024-11-19T02:22:15.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
72042024-11-19T02:22:15.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72052024-11-19T02:22:15.775ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: ffe74824-0c08-48e1-a755-fb123e8dc181, lookup_type: ById(ffe74824-0c08-48e1-a755-fb123e8dc181) } result = Ok(())
72062024-11-19T02:22:15.775ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72072024-11-19T02:22:15.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72082024-11-19T02:22:15.776ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 49.870091ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
72092024-11-19T02:22:15.776ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
72102024-11-19T02:22:15.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
72112024-11-19T02:22:15.777ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 50.965984ms iteration = 26 status = 0
72122024-11-19T02:22:15.782ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72132024-11-19T02:22:15.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72142024-11-19T02:22:15.787ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 60.396802ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
72152024-11-19T02:22:15.787ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
72162024-11-19T02:22:15.787ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
72172024-11-19T02:22:15.788ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
72182024-11-19T02:22:15.788ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e2080e5b-b2d6-46fc-8dc7-c9d49add5bab", "content-length": "26", "date": "Tue, 19 Nov 2024 02:22:15 GMT"} })
72192024-11-19T02:22:15.788ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
72202024-11-19T02:22:15.788ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
72212024-11-19T02:22:15.788ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "29230909-542c-43cb-ac8e-ddc912c82ea3", "content-length": "26", "date": "Tue, 19 Nov 2024 02:22:15 GMT"} })
72222024-11-19T02:22:15.788ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
72232024-11-19T02:22:15.789ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
72242024-11-19T02:22:15.789ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 62.409475ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
72252024-11-19T02:22:15.791ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
72262024-11-19T02:22:15.791ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
72272024-11-19T02:22:15.814ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 87.887926ms iteration = 26 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
72282024-11-19T02:22:15.817ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 90.515067ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
72292024-11-19T02:22:15.817ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
72302024-11-19T02:22:15.817ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
72312024-11-19T02:22:15.817ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 90.717639ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
72322024-11-19T02:22:15.817ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 zone_address = fd00:1122:3344:101::2
72332024-11-19T02:22:15.818ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
72342024-11-19T02:22:15.818ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a5743b1d-4aa7-4b39-9e72-841f67fc194b", "content-length": "26", "date": "Tue, 19 Nov 2024 02:22:15 GMT"} })
72352024-11-19T02:22:15.818ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
72362024-11-19T02:22:15.820ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
72372024-11-19T02:22:15.872ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 145.704408ms iteration = 30 status = {"physical_disks_added":0}
72382024-11-19T02:22:15.886ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
72392024-11-19T02:22:15.887ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba7a7466-62a3-4bce-b957-b2d72e26679c", "content-length": "2", "date": "Tue, 19 Nov 2024 02:22:15 GMT"} })
72402024-11-19T02:22:15.887ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72412024-11-19T02:22:15.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72422024-11-19T02:22:15.889ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
72432024-11-19T02:22:15.889ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72442024-11-19T02:22:15.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
72452024-11-19T02:22:15.891ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
72462024-11-19T02:22:15.891ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72472024-11-19T02:22:15.891ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 164.765477ms iteration = 26 status = {}
72482024-11-19T02:22:15.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72492024-11-19T02:22:15.922ZINFOnexus (BackgroundTasks): VPC route manager sled ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
72502024-11-19T02:22:15.922ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
72512024-11-19T02:22:15.923ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d4df9093-1c62-4224-9402-5ce63461b63e", "content-length": "372", "date": "Tue, 19 Nov 2024 02:22:15 GMT"} })
72522024-11-19T02:22:15.923ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72532024-11-19T02:22:15.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72542024-11-19T02:22:15.925ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72552024-11-19T02:22:15.925ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 198.720705ms iteration = 26 status = null
72562024-11-19T02:22:15.927ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
72572024-11-19T02:22:15.927ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72582024-11-19T02:22:15.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72592024-11-19T02:22:15.953ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
72602024-11-19T02:22:15.953ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
72612024-11-19T02:22:15.953ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3020b9fb-ebbc-4967-9ea0-91b54a3a0abe", "date": "Tue, 19 Nov 2024 02:22:15 GMT"} })
72622024-11-19T02:22:15.953ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72632024-11-19T02:22:15.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72642024-11-19T02:22:15.956ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72652024-11-19T02:22:15.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72662024-11-19T02:22:15.959ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72672024-11-19T02:22:15.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72682024-11-19T02:22:15.969ZINFOnexus (BackgroundTasks): VPC route manager sled ffe74824-0c08-48e1-a755-fb123e8dc181 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
72692024-11-19T02:22:15.969ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
72702024-11-19T02:22:15.970ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ed8be22a-aff4-42be-b1f0-b9bc2e12bbd3", "date": "Tue, 19 Nov 2024 02:22:15 GMT"} })
72712024-11-19T02:22:15.972ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 245.117506ms iteration = 28 status = {}
72722024-11-19T02:22:15.996ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
72732024-11-19T02:22:15.999ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "75c63108-b658-4f8f-97dd-6de8bd73322c", "content-length": "691", "date": "Tue, 19 Nov 2024 02:22:15 GMT"} })
72742024-11-19T02:22:15.999ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
72752024-11-19T02:22:15.999ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
72762024-11-19T02:22:15.999ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
72772024-11-19T02:22:16.001ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 274.31477ms iteration = 27 status = {}
72782024-11-19T02:22:16.018ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72792024-11-19T02:22:16.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72802024-11-19T02:22:16.021ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 20bc3881-e2ee-4d8d-b84b-b0c1e478721f, rack_id: a894e92e-d765-4f15-b6b7-cb9ca46d1860, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8597d802-6d4d-4493-88de-333a1f340c20) } rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0
72812024-11-19T02:22:16.021ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72822024-11-19T02:22:16.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72832024-11-19T02:22:16.032ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
72842024-11-19T02:22:16.033ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "782a5402-06e7-44d6-99e4-3585fa4e7ec3", "content-length": "134", "date": "Tue, 19 Nov 2024 02:22:15 GMT"} })
72852024-11-19T02:22:16.033ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
72862024-11-19T02:22:16.033ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8597d802-6d4d-4493-88de-333a1f340c20
72872024-11-19T02:22:16.033ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
72882024-11-19T02:22:16.033ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
72892024-11-19T02:22:16.033ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72902024-11-19T02:22:16.033ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72912024-11-19T02:22:16.033ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72922024-11-19T02:22:16.033ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
72932024-11-19T02:22:16.033ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72942024-11-19T02:22:16.033ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
72952024-11-19T02:22:16.033ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
72962024-11-19T02:22:16.033ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72972024-11-19T02:22:16.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72982024-11-19T02:22:16.036ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
72992024-11-19T02:22:16.036ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "3e3ffa2a-b44c-43c6-9406-87f802504ade", "content-length": "2", "date": "Tue, 19 Nov 2024 02:22:15 GMT"} })
73002024-11-19T02:22:16.036ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
73012024-11-19T02:22:16.036ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f43daca8-ba73-4912-a195-2c926db61303", "content-length": "52", "date": "Tue, 19 Nov 2024 02:22:15 GMT"} })
73022024-11-19T02:22:16.036ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0
73032024-11-19T02:22:16.036ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
73042024-11-19T02:22:16.184ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = 26a57882-88bb-46a8-a631-3b7ed362c578 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
73052024-11-19T02:22:16.184ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = 26a57882-88bb-46a8-a631-3b7ed362c578 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
73062024-11-19T02:22:16.187ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3315 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = 26a57882-88bb-46a8-a631-3b7ed362c578 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
73072024-11-19T02:22:16.202ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "716d5ae7-1a3e-4a54-9eb4-4d73b33a61db", "date": "Tue, 19 Nov 2024 02:22:15 GMT"} })
73082024-11-19T02:22:16.202ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch = Switch0
73092024-11-19T02:22:16.202ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
73102024-11-19T02:22:16.203ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "02a0910e-b2a4-4b3f-b68d-07417269a298", "content-length": "682", "date": "Tue, 19 Nov 2024 02:22:16 GMT"} })
73112024-11-19T02:22:16.203ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73122024-11-19T02:22:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73132024-11-19T02:22:16.207ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73142024-11-19T02:22:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73152024-11-19T02:22:16.210ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73162024-11-19T02:22:16.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73172024-11-19T02:22:16.213ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73182024-11-19T02:22:16.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73192024-11-19T02:22:16.222ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 495.119647ms iteration = 26 status = {}
73202024-11-19T02:22:16.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = df8faebd-f373-4292-b8b5-042b07804e0f roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
73212024-11-19T02:22:16.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = df8faebd-f373-4292-b8b5-042b07804e0f resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
73222024-11-19T02:22:16.383ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2108 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = df8faebd-f373-4292-b8b5-042b07804e0f response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
73232024-11-19T02:22:16.418ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:64735
73242024-11-19T02:22:16.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64735 req_id = 64edf35c-edee-46ef-8f5e-45cdd0381c36 roles = RoleSet { roles: {} } uri = /metrics/producers
73252024-11-19T02:22:16.419ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64735 req_id = 64edf35c-edee-46ef-8f5e-45cdd0381c36 resource = Database result = Ok(()) uri = /metrics/producers
73262024-11-19T02:22:16.434ZINFOnexus: assigned collector to new producer collector_id = 3980dd20-a3be-40d3-b9e5-094b8ed4b785 file = nexus/src/app/oximeter.rs:76 producer_id = 8e12c1ab-c863-4549-add8-1474df60b506
73272024-11-19T02:22:16.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 15774 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64735 req_id = 64edf35c-edee-46ef-8f5e-45cdd0381c36 response_code = 201 uri = /metrics/producers
73282024-11-19T02:22:17.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 1ebfb590-d999-426e-939d-b490559aa07f roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
73292024-11-19T02:22:17.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 1ebfb590-d999-426e-939d-b490559aa07f resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
73302024-11-19T02:22:17.409ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2117 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 1ebfb590-d999-426e-939d-b490559aa07f response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
73312024-11-19T02:22:18.433ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ade685e0-73d6-45b2-9281-455a42911236 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
73322024-11-19T02:22:18.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ade685e0-73d6-45b2-9281-455a42911236 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
73332024-11-19T02:22:18.435ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2340 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ade685e0-73d6-45b2-9281-455a42911236 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
73342024-11-19T02:22:18.781ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:62627
73352024-11-19T02:22:18.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:62627 req_id = 729971c2-2bb6-4d01-b0ad-ec21d6a9cd74 roles = RoleSet { roles: {} } uri = /metrics/producers
73362024-11-19T02:22:18.782ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:62627 req_id = 729971c2-2bb6-4d01-b0ad-ec21d6a9cd74 resource = Database result = Ok(()) uri = /metrics/producers
73372024-11-19T02:22:18.793ZINFOnexus: assigned collector to new producer collector_id = 3980dd20-a3be-40d3-b9e5-094b8ed4b785 file = nexus/src/app/oximeter.rs:76 producer_id = ddf2e18a-a42b-49da-ad7e-ae7886578501
73382024-11-19T02:22:18.793ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 11209 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:62627 req_id = 729971c2-2bb6-4d01-b0ad-ec21d6a9cd74 response_code = 201 uri = /metrics/producers
73392024-11-19T02:22:18.816ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:50918
73402024-11-19T02:22:18.816ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50918 req_id = 17bda45c-28ed-4133-99fc-907c22241830 roles = RoleSet { roles: {} } uri = /metrics/producers
73412024-11-19T02:22:18.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50918 req_id = 17bda45c-28ed-4133-99fc-907c22241830 resource = Database result = Ok(()) uri = /metrics/producers
73422024-11-19T02:22:18.853ZINFOnexus: assigned collector to new producer collector_id = 3980dd20-a3be-40d3-b9e5-094b8ed4b785 file = nexus/src/app/oximeter.rs:76 producer_id = 4f0e9442-b890-4bd0-8290-362b3608ea68
73432024-11-19T02:22:18.853ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37295 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50918 req_id = 17bda45c-28ed-4133-99fc-907c22241830 response_code = 201 uri = /metrics/producers
73442024-11-19T02:22:19.457ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 914a8df0-0846-4055-80ac-565f6e9e50db roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
73452024-11-19T02:22:19.457ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 914a8df0-0846-4055-80ac-565f6e9e50db resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
73462024-11-19T02:22:19.459ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2001 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 914a8df0-0846-4055-80ac-565f6e9e50db response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
73472024-11-19T02:22:20.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 30912e4f-c85e-4b1f-acdd-3cefe9bb1ae0 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
73482024-11-19T02:22:20.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 30912e4f-c85e-4b1f-acdd-3cefe9bb1ae0 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
73492024-11-19T02:22:20.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2436 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 30912e4f-c85e-4b1f-acdd-3cefe9bb1ae0 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
73502024-11-19T02:22:21.507ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 785b16fb-7327-44da-aeba-5ed294fc3989 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
73512024-11-19T02:22:21.508ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 785b16fb-7327-44da-aeba-5ed294fc3989 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
73522024-11-19T02:22:21.510ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2142 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 785b16fb-7327-44da-aeba-5ed294fc3989 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
73532024-11-19T02:22:22.156ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1607 local_addr = [fd00:1122:3344:101::c]:60807 method = GET remote_addr = [fd00:1122:3344:101::d]:57844 req_id = c555be6b-9446-4aa0-86a7-4d4be8e03fd0 response_code = 200 uri = /9f0b435f-0000-451e-9dbc-dcec71543c30
73542024-11-19T02:22:22.531ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 66145505-3ae7-4fd6-9930-f9aa57d5f226 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
73552024-11-19T02:22:22.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 66145505-3ae7-4fd6-9930-f9aa57d5f226 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
73562024-11-19T02:22:22.534ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2368 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 66145505-3ae7-4fd6-9930-f9aa57d5f226 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
73572024-11-19T02:22:23.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6b35abb2-3d42-49c3-a370-09469cda0b21 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
73582024-11-19T02:22:23.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6b35abb2-3d42-49c3-a370-09469cda0b21 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
73592024-11-19T02:22:23.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2550 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6b35abb2-3d42-49c3-a370-09469cda0b21 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
73602024-11-19T02:22:24.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0dfcb64a-ed5d-4604-af93-779019500d1c roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
73612024-11-19T02:22:24.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0dfcb64a-ed5d-4604-af93-779019500d1c resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
73622024-11-19T02:22:24.580ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1945 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0dfcb64a-ed5d-4604-af93-779019500d1c response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
73632024-11-19T02:22:25.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 12644e33-61ff-406b-b68e-6054c1709a28 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
73642024-11-19T02:22:25.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 12644e33-61ff-406b-b68e-6054c1709a28 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
73652024-11-19T02:22:25.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2484 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 12644e33-61ff-406b-b68e-6054c1709a28 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
73662024-11-19T02:22:25.727ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
73672024-11-19T02:22:25.727ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
73682024-11-19T02:22:25.727ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73692024-11-19T02:22:25.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73702024-11-19T02:22:25.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73712024-11-19T02:22:25.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73722024-11-19T02:22:25.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73732024-11-19T02:22:25.729ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73742024-11-19T02:22:25.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73752024-11-19T02:22:25.731ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.543472ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
73762024-11-19T02:22:25.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
73772024-11-19T02:22:25.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73782024-11-19T02:22:25.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73792024-11-19T02:22:25.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73802024-11-19T02:22:25.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73812024-11-19T02:22:25.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73822024-11-19T02:22:25.739ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
73832024-11-19T02:22:25.739ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73842024-11-19T02:22:25.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73852024-11-19T02:22:25.748ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
73862024-11-19T02:22:25.748ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.703949ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
73872024-11-19T02:22:26.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a2b39184-1ffb-4da7-a8e0-903c9b967814 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
73882024-11-19T02:22:26.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a2b39184-1ffb-4da7-a8e0-903c9b967814 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
73892024-11-19T02:22:26.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2346 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a2b39184-1ffb-4da7-a8e0-903c9b967814 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
73902024-11-19T02:22:27.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 96e24170-b224-4f99-9634-9541c9eb02aa roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
73912024-11-19T02:22:27.653ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 96e24170-b224-4f99-9634-9541c9eb02aa resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
73922024-11-19T02:22:27.655ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2480 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 96e24170-b224-4f99-9634-9541c9eb02aa response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
73932024-11-19T02:22:28.678ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ebe59ef4-1e83-4c43-aa6f-b9d1e3dbea25 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
73942024-11-19T02:22:28.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ebe59ef4-1e83-4c43-aa6f-b9d1e3dbea25 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
73952024-11-19T02:22:28.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2406 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ebe59ef4-1e83-4c43-aa6f-b9d1e3dbea25 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
73962024-11-19T02:22:29.703ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ec418a06-2c62-40b0-9855-b3427d050f38 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
73972024-11-19T02:22:29.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ec418a06-2c62-40b0-9855-b3427d050f38 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
73982024-11-19T02:22:29.705ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2358 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ec418a06-2c62-40b0-9855-b3427d050f38 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
73992024-11-19T02:22:30.728ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ca1f701d-dab9-4e3d-a497-88ccad35faf4 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
74002024-11-19T02:22:30.728ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ca1f701d-dab9-4e3d-a497-88ccad35faf4 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
74012024-11-19T02:22:30.730ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2432 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ca1f701d-dab9-4e3d-a497-88ccad35faf4 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
74022024-11-19T02:22:31.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d2bc66fe-b795-4d81-a533-b1f08d9c90c9 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
74032024-11-19T02:22:31.755ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d2bc66fe-b795-4d81-a533-b1f08d9c90c9 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
74042024-11-19T02:22:31.757ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2381 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d2bc66fe-b795-4d81-a533-b1f08d9c90c9 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
74052024-11-19T02:22:32.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 08da647d-3d64-45cf-9a92-97dbdfe39ca6 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
74062024-11-19T02:22:32.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 08da647d-3d64-45cf-9a92-97dbdfe39ca6 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
74072024-11-19T02:22:32.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2663 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 08da647d-3d64-45cf-9a92-97dbdfe39ca6 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
74082024-11-19T02:22:33.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 431af64d-8411-46fb-91f8-b079a4ebcfe2 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
74092024-11-19T02:22:33.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 431af64d-8411-46fb-91f8-b079a4ebcfe2 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
74102024-11-19T02:22:33.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2344 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 431af64d-8411-46fb-91f8-b079a4ebcfe2 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
74112024-11-19T02:22:34.828ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 91de296a-02aa-4e43-92b1-254cf350d439 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
74122024-11-19T02:22:34.829ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 91de296a-02aa-4e43-92b1-254cf350d439 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
74132024-11-19T02:22:34.831ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2577 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 91de296a-02aa-4e43-92b1-254cf350d439 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
74142024-11-19T02:22:35.727ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
74152024-11-19T02:22:35.727ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
74162024-11-19T02:22:35.727ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74172024-11-19T02:22:35.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74182024-11-19T02:22:35.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74192024-11-19T02:22:35.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74202024-11-19T02:22:35.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74212024-11-19T02:22:35.729ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74222024-11-19T02:22:35.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74232024-11-19T02:22:35.732ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.717734ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
74242024-11-19T02:22:35.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
74252024-11-19T02:22:35.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74262024-11-19T02:22:35.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74272024-11-19T02:22:35.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74282024-11-19T02:22:35.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74292024-11-19T02:22:35.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74302024-11-19T02:22:35.739ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
74312024-11-19T02:22:35.739ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74322024-11-19T02:22:35.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74332024-11-19T02:22:35.748ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
74342024-11-19T02:22:35.748ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.385634ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
74352024-11-19T02:22:35.852ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4b7d5234-edc3-4650-b0ff-6cf19bcc38c3 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
74362024-11-19T02:22:35.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4b7d5234-edc3-4650-b0ff-6cf19bcc38c3 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
74372024-11-19T02:22:35.854ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2063 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4b7d5234-edc3-4650-b0ff-6cf19bcc38c3 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
74382024-11-19T02:22:36.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 7db137e0-353c-4926-8b8f-c013f7bed8b0 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
74392024-11-19T02:22:36.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 7db137e0-353c-4926-8b8f-c013f7bed8b0 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
74402024-11-19T02:22:36.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2320 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 7db137e0-353c-4926-8b8f-c013f7bed8b0 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
74412024-11-19T02:22:37.156ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1714 local_addr = [fd00:1122:3344:101::c]:60807 method = GET remote_addr = [fd00:1122:3344:101::d]:57844 req_id = 6a469581-a8e8-4159-aaa9-3627ab3d8c0c response_code = 200 uri = /9f0b435f-0000-451e-9dbc-dcec71543c30
74422024-11-19T02:22:37.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 7eb4d279-9940-496a-ba3c-b873d2d4adbc roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
74432024-11-19T02:22:37.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 7eb4d279-9940-496a-ba3c-b873d2d4adbc resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
74442024-11-19T02:22:37.904ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2432 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 7eb4d279-9940-496a-ba3c-b873d2d4adbc response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
74452024-11-19T02:22:38.927ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = f9680aea-1a84-40c0-b57f-4a068ba0c86d roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
74462024-11-19T02:22:38.928ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = f9680aea-1a84-40c0-b57f-4a068ba0c86d resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
74472024-11-19T02:22:38.930ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2276 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = f9680aea-1a84-40c0-b57f-4a068ba0c86d response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
74482024-11-19T02:22:39.951ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 5888cd7e-78b2-4d8e-adef-65b6203dbfa3 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
74492024-11-19T02:22:39.952ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 5888cd7e-78b2-4d8e-adef-65b6203dbfa3 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
74502024-11-19T02:22:39.954ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2652 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 5888cd7e-78b2-4d8e-adef-65b6203dbfa3 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
74512024-11-19T02:22:40.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 2d361d8a-9ccc-42a3-b37a-18c981265026 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
74522024-11-19T02:22:40.975ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 2d361d8a-9ccc-42a3-b37a-18c981265026 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
74532024-11-19T02:22:40.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2375 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 2d361d8a-9ccc-42a3-b37a-18c981265026 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
74542024-11-19T02:22:42.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 77968dbe-b21a-4f64-8079-66cc67e2ec6a roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
74552024-11-19T02:22:42.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 77968dbe-b21a-4f64-8079-66cc67e2ec6a resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
74562024-11-19T02:22:42.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2705 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 77968dbe-b21a-4f64-8079-66cc67e2ec6a response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
74572024-11-19T02:22:42.147ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = b2f47d5a-30b3-48a4-bd1b-d1f84bec4c69 roles = RoleSet { roles: {} } uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?sort_by=id_ascending
74582024-11-19T02:22:42.148ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = b2f47d5a-30b3-48a4-bd1b-d1f84bec4c69 resource = Database result = Ok(()) uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?sort_by=id_ascending
74592024-11-19T02:22:42.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3087 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = b2f47d5a-30b3-48a4-bd1b-d1f84bec4c69 response_code = 200 uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?sort_by=id_ascending
74602024-11-19T02:22:42.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = 26b54322-75e0-4b80-962d-2a81940adc08 roles = RoleSet { roles: {} } uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZmU3NDgyNC0wYzA4LTQ4ZTEtYTc1NS1mYjEyM2U4ZGMxODEifX0%3D
74612024-11-19T02:22:42.151ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = 26b54322-75e0-4b80-962d-2a81940adc08 resource = Database result = Ok(()) uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZmU3NDgyNC0wYzA4LTQ4ZTEtYTc1NS1mYjEyM2U4ZGMxODEifX0%3D
74622024-11-19T02:22:42.153ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2348 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = 26b54322-75e0-4b80-962d-2a81940adc08 response_code = 200 uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZmU3NDgyNC0wYzA4LTQ4ZTEtYTc1NS1mYjEyM2U4ZGMxODEifX0%3D
74632024-11-19T02:22:43.028ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9b4a34bb-290f-41c4-aaab-7116335e3475 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
74642024-11-19T02:22:43.028ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9b4a34bb-290f-41c4-aaab-7116335e3475 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
74652024-11-19T02:22:43.030ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2582 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9b4a34bb-290f-41c4-aaab-7116335e3475 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
74662024-11-19T02:22:44.053ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 8d04d20d-379c-4fe4-80e3-f35b49c16fc3 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
74672024-11-19T02:22:44.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 8d04d20d-379c-4fe4-80e3-f35b49c16fc3 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
74682024-11-19T02:22:44.055ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2284 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 8d04d20d-379c-4fe4-80e3-f35b49c16fc3 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
74692024-11-19T02:22:45.078ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 982cf86d-6082-41e8-a527-ad90825f4443 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
74702024-11-19T02:22:45.079ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 982cf86d-6082-41e8-a527-ad90825f4443 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
74712024-11-19T02:22:45.081ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2507 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 982cf86d-6082-41e8-a527-ad90825f4443 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
74722024-11-19T02:22:45.726ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
74732024-11-19T02:22:45.726ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
74742024-11-19T02:22:45.726ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 15 reason = Timeout
74752024-11-19T02:22:45.726ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 15 reason = Timeout
74762024-11-19T02:22:45.726ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
74772024-11-19T02:22:45.726ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
74782024-11-19T02:22:45.726ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
74792024-11-19T02:22:45.726ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
74802024-11-19T02:22:45.726ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 15 reason = Timeout
74812024-11-19T02:22:45.726ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
74822024-11-19T02:22:45.726ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
74832024-11-19T02:22:45.726ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
74842024-11-19T02:22:45.726ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-19 02:12:45.726507878 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
74852024-11-19T02:22:45.726ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
74862024-11-19T02:22:45.726ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
74872024-11-19T02:22:45.726ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
74882024-11-19T02:22:45.726ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 15 reason = Timeout
74892024-11-19T02:22:45.726ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 15 reason = Timeout
74902024-11-19T02:22:45.726ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
74912024-11-19T02:22:45.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
74922024-11-19T02:22:45.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
74932024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
74942024-11-19T02:22:45.727ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2d59cdb7-e3b1-4e94-afa3-f64f69928234.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a949a8d8-46c7-4423-b760-c03f98ccf638.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b190a9bf-d8b7-43c3-add4-e113c9b89870.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b190a9bf-d8b7-43c3-add4-e113c9b89870.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1663, tv_nsec: 509382182 } })
74952024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
74962024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
74972024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
74982024-11-19T02:22:45.727ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("27d1a6ca-1b76-4956-aefa-e234c7d60cd0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("91bdcbd0-987b-49c4-8200-fc3e8f332b6b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("91bdcbd0-987b-49c4-8200-fc3e8f332b6b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1663, tv_nsec: 509619084 } })
74992024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 31 reason = Timeout
75002024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75012024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
75022024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
75032024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
75042024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
75052024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75062024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
75072024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
75082024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
75092024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75102024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
75112024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
75122024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
75132024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
75142024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
75152024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
75162024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
75172024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75182024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
75192024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
75202024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
75212024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
75222024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
75232024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 29 reason = Timeout
75242024-11-19T02:22:45.727ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
75252024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75262024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
75272024-11-19T02:22:45.727ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
75282024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
75292024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
75302024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
75312024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
75322024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
75332024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
75342024-11-19T02:22:45.727ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115
75352024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.081\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115"}
75362024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
75372024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
75382024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75392024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75402024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
75412024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
75422024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75432024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
75442024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
75452024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
75462024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
75472024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.465116ms iteration = 15 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
75482024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75492024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
75502024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75512024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75522024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.381066ms iteration = 15 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
75532024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
75542024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
75552024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
75562024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75572024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
75582024-11-19T02:22:45.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
75592024-11-19T02:22:45.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
75602024-11-19T02:22:45.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
75612024-11-19T02:22:45.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75622024-11-19T02:22:45.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75632024-11-19T02:22:45.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
75642024-11-19T02:22:45.728ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
75652024-11-19T02:22:45.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
75662024-11-19T02:22:45.729ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1663, tv_nsec: 511750599 } })
75672024-11-19T02:22:45.729ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
75682024-11-19T02:22:45.730ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1663, tv_nsec: 512395946 } })
75692024-11-19T02:22:45.730ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
75702024-11-19T02:22:45.730ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
75712024-11-19T02:22:45.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
75722024-11-19T02:22:45.730ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75732024-11-19T02:22:45.731ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-19 02:12:45.726507878 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
75742024-11-19T02:22:45.731ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.647443ms iteration = 14 status = {"expiration":"2024-11-19T02:12:45.726507878Z","pruned":[]}
75752024-11-19T02:22:45.732ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
75762024-11-19T02:22:45.732ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
75772024-11-19T02:22:45.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
75782024-11-19T02:22:45.732ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75792024-11-19T02:22:45.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
75802024-11-19T02:22:45.734ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75812024-11-19T02:22:45.734ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 7.333074ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
75822024-11-19T02:22:45.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75832024-11-19T02:22:45.735ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75842024-11-19T02:22:45.735ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75852024-11-19T02:22:45.735ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75862024-11-19T02:22:45.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75872024-11-19T02:22:45.737ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
75882024-11-19T02:22:45.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
75892024-11-19T02:22:45.737ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
75902024-11-19T02:22:45.737ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
75912024-11-19T02:22:45.737ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
75922024-11-19T02:22:45.737ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
75932024-11-19T02:22:45.737ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
75942024-11-19T02:22:45.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
75952024-11-19T02:22:45.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
75962024-11-19T02:22:45.738ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
75972024-11-19T02:22:45.738ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75982024-11-19T02:22:45.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75992024-11-19T02:22:45.739ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76002024-11-19T02:22:45.740ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76012024-11-19T02:22:45.740ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 13.329683ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
76022024-11-19T02:22:45.741ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 13.614276ms iteration = 27 status = {"errors":[],"records_set_to_done":[]}
76032024-11-19T02:22:45.742ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
76042024-11-19T02:22:45.742ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
76052024-11-19T02:22:45.742ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 14.82025ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
76062024-11-19T02:22:45.742ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
76072024-11-19T02:22:45.742ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76082024-11-19T02:22:45.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76092024-11-19T02:22:45.742ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
76102024-11-19T02:22:45.742ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
76112024-11-19T02:22:45.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
76122024-11-19T02:22:45.743ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76132024-11-19T02:22:45.744ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76142024-11-19T02:22:45.745ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76152024-11-19T02:22:45.745ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76162024-11-19T02:22:45.747ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
76172024-11-19T02:22:45.747ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76182024-11-19T02:22:45.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76192024-11-19T02:22:45.748ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
76202024-11-19T02:22:45.748ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76212024-11-19T02:22:45.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76222024-11-19T02:22:45.749ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
76232024-11-19T02:22:45.749ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
76242024-11-19T02:22:45.749ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
76252024-11-19T02:22:45.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
76262024-11-19T02:22:45.750ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 23.391558ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
76272024-11-19T02:22:45.750ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 23.58679ms iteration = 27 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
76282024-11-19T02:22:45.751ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76292024-11-19T02:22:45.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76302024-11-19T02:22:45.752ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76312024-11-19T02:22:45.752ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
76322024-11-19T02:22:45.752ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
76332024-11-19T02:22:45.752ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
76342024-11-19T02:22:45.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
76352024-11-19T02:22:45.753ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1663, tv_nsec: 535854435 } })
76362024-11-19T02:22:45.753ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
76372024-11-19T02:22:45.753ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76382024-11-19T02:22:45.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76392024-11-19T02:22:45.754ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76402024-11-19T02:22:45.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76412024-11-19T02:22:45.754ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
76422024-11-19T02:22:45.754ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76432024-11-19T02:22:45.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76442024-11-19T02:22:45.756ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76452024-11-19T02:22:45.756ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76462024-11-19T02:22:45.758ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76472024-11-19T02:22:45.759ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
76482024-11-19T02:22:45.759ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76492024-11-19T02:22:45.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76502024-11-19T02:22:45.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
76512024-11-19T02:22:45.764ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
76522024-11-19T02:22:45.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
76532024-11-19T02:22:45.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
76542024-11-19T02:22:45.764ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76552024-11-19T02:22:45.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76562024-11-19T02:22:45.765ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
76572024-11-19T02:22:45.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
76582024-11-19T02:22:45.771ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 44.191016ms iteration = 31 status = {"physical_disks_added":0}
76592024-11-19T02:22:45.780ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
76602024-11-19T02:22:45.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
76612024-11-19T02:22:45.783ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 55.901ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
76622024-11-19T02:22:45.785ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 58.029594ms iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
76632024-11-19T02:22:45.785ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
76642024-11-19T02:22:45.785ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 58.121005ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
76652024-11-19T02:22:45.793ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
76662024-11-19T02:22:45.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
76672024-11-19T02:22:45.795ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76682024-11-19T02:22:45.795ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
76692024-11-19T02:22:45.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
76702024-11-19T02:22:45.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76712024-11-19T02:22:45.797ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 69.805949ms iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
76722024-11-19T02:22:45.798ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76732024-11-19T02:22:45.798ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
76742024-11-19T02:22:45.798ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
76752024-11-19T02:22:45.798ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
76762024-11-19T02:22:45.798ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
76772024-11-19T02:22:45.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76782024-11-19T02:22:45.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
76792024-11-19T02:22:45.798ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
76802024-11-19T02:22:45.798ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
76812024-11-19T02:22:45.798ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
76822024-11-19T02:22:45.798ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
76832024-11-19T02:22:45.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
76842024-11-19T02:22:45.799ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
76852024-11-19T02:22:45.800ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
76862024-11-19T02:22:45.800ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 72.54819ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
76872024-11-19T02:22:45.800ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76882024-11-19T02:22:45.800ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76892024-11-19T02:22:45.800ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76902024-11-19T02:22:45.801ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
76912024-11-19T02:22:45.801ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
76922024-11-19T02:22:45.801ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 73.724364ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
76932024-11-19T02:22:45.804ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
76942024-11-19T02:22:45.804ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
76952024-11-19T02:22:45.804ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
76962024-11-19T02:22:45.804ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
76972024-11-19T02:22:45.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
76982024-11-19T02:22:45.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
76992024-11-19T02:22:45.805ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: ffe74824-0c08-48e1-a755-fb123e8dc181, lookup_type: ById(ffe74824-0c08-48e1-a755-fb123e8dc181) } result = Ok(())
77002024-11-19T02:22:45.805ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77012024-11-19T02:22:45.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77022024-11-19T02:22:45.807ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
77032024-11-19T02:22:45.807ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 79.901915ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
77042024-11-19T02:22:45.807ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 80.238439ms iteration = 27 status = 0
77052024-11-19T02:22:45.808ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
77062024-11-19T02:22:45.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
77072024-11-19T02:22:45.810ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77082024-11-19T02:22:45.812ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
77092024-11-19T02:22:45.812ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
77102024-11-19T02:22:45.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
77112024-11-19T02:22:45.826ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77122024-11-19T02:22:45.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77132024-11-19T02:22:45.834ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
77142024-11-19T02:22:45.834ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 8c04fa4d-031f-4603-9b0e-246b45d39276 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
77152024-11-19T02:22:45.834ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77162024-11-19T02:22:45.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77172024-11-19T02:22:45.835ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
77182024-11-19T02:22:45.835ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = af79c7eb-bc4d-42f8-9217-8b35affeeebb dns_zone_name = oxide.test found_so_far = 0 version = 2
77192024-11-19T02:22:45.835ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
77202024-11-19T02:22:45.836ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77212024-11-19T02:22:45.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
77222024-11-19T02:22:45.837ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77232024-11-19T02:22:45.840ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
77242024-11-19T02:22:45.840ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77252024-11-19T02:22:45.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77262024-11-19T02:22:45.840ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
77272024-11-19T02:22:45.840ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
77282024-11-19T02:22:45.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
77292024-11-19T02:22:45.842ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 8c04fa4d-031f-4603-9b0e-246b45d39276 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
77302024-11-19T02:22:45.842ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
77312024-11-19T02:22:45.842ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-19 02:10:27.714570 UTC dns_group = internal generation = 1
77322024-11-19T02:22:45.842ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 116.433923ms iteration = 15 status = {"generation":1}
77332024-11-19T02:22:45.843ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = af79c7eb-bc4d-42f8-9217-8b35affeeebb dns_zone_name = oxide.test found_so_far = 1 version = 2
77342024-11-19T02:22:45.843ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
77352024-11-19T02:22:45.843ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-19 02:10:28.769117 UTC dns_group = external generation = 2
77362024-11-19T02:22:45.843ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 116.725857ms iteration = 15 status = {"generation":2}
77372024-11-19T02:22:45.853ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-19T02:09:41.910054Z, time_modified: 2024-11-19T02:09:41.910054Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 78638afa-e975-44a9-b764-0afec18d156f, db_silo: Silo { identity: SiloIdentity { id: 78638afa-e975-44a9-b764-0afec18d156f, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-19T02:10:28.623188Z, time_modified: 2024-11-19T02:10:28.623188Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "fe94815f3f5502a309deafc95cd58d4fe61e984b7bd8ad11309589068beb64f5" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 78638afa-e975-44a9-b764-0afec18d156f, db_silo: Silo { identity: SiloIdentity { id: 78638afa-e975-44a9-b764-0afec18d156f, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-19T02:10:28.623188Z, time_modified: 2024-11-19T02:10:28.623188Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "fe94815f3f5502a309deafc95cd58d4fe61e984b7bd8ad11309589068beb64f5" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
77382024-11-19T02:22:45.853ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 127.127535ms iteration = 15 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"78638afa-e975-44a9-b764-0afec18d156f","tls_certs":["fe94815f3f5502a309deafc95cd58d4fe61e984b7bd8ad11309589068beb64f5"]}},"default_endpoint":{"silo_id":"78638afa-e975-44a9-b764-0afec18d156f","tls_certs":["fe94815f3f5502a309deafc95cd58d4fe61e984b7bd8ad11309589068beb64f5"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
77392024-11-19T02:22:45.864ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
77402024-11-19T02:22:45.864ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 136.943518ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
77412024-11-19T02:22:45.896ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
77422024-11-19T02:22:45.896ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
77432024-11-19T02:22:45.897ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d02daa8d-5558-472a-abd4-7049afda1458", "content-length": "26", "date": "Tue, 19 Nov 2024 02:22:45 GMT"} })
77442024-11-19T02:22:45.897ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
77452024-11-19T02:22:45.899ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
77462024-11-19T02:22:45.919ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77472024-11-19T02:22:45.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77482024-11-19T02:22:45.921ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77492024-11-19T02:22:45.923ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
77502024-11-19T02:22:45.924ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77512024-11-19T02:22:45.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77522024-11-19T02:22:45.926ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
77532024-11-19T02:22:45.934ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77542024-11-19T02:22:45.937ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
77552024-11-19T02:22:45.937ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77562024-11-19T02:22:45.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77572024-11-19T02:22:46.073ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
77582024-11-19T02:22:46.104ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = fe8b1d05-ca03-4a96-95ec-a5330fe38b3f roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
77592024-11-19T02:22:46.104ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = fe8b1d05-ca03-4a96-95ec-a5330fe38b3f resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
77602024-11-19T02:22:46.107ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 zone_address = fd00:1122:3344:101::2
77612024-11-19T02:22:46.107ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
77622024-11-19T02:22:46.107ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3531 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = fe8b1d05-ca03-4a96-95ec-a5330fe38b3f response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
77632024-11-19T02:22:46.108ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b84289cd-8d07-42a3-a8a4-ad41243989c1", "content-length": "26", "date": "Tue, 19 Nov 2024 02:22:45 GMT"} })
77642024-11-19T02:22:46.108ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
77652024-11-19T02:22:46.108ZINFOnexus (BackgroundTasks): VPC route manager sled ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
77662024-11-19T02:22:46.108ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
77672024-11-19T02:22:46.110ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
77682024-11-19T02:22:46.123ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "164f9412-e226-4286-9b59-db160cbcde05", "content-length": "372", "date": "Tue, 19 Nov 2024 02:22:46 GMT"} })
77692024-11-19T02:22:46.123ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77702024-11-19T02:22:46.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77712024-11-19T02:22:46.140ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
77722024-11-19T02:22:46.140ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
77732024-11-19T02:22:46.140ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "eca8a747-8acb-4a19-b13e-8ff1f7101532", "date": "Tue, 19 Nov 2024 02:22:46 GMT"} })
77742024-11-19T02:22:46.141ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77752024-11-19T02:22:46.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77762024-11-19T02:22:46.143ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77772024-11-19T02:22:46.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77782024-11-19T02:22:46.146ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77792024-11-19T02:22:46.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77802024-11-19T02:22:46.180ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
77812024-11-19T02:22:46.180ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
77822024-11-19T02:22:46.180ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4f516e3c-2b2d-4862-aa61-578116408ab3", "content-length": "26", "date": "Tue, 19 Nov 2024 02:22:45 GMT"} })
77832024-11-19T02:22:46.180ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
77842024-11-19T02:22:46.182ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
77852024-11-19T02:22:46.215ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
77862024-11-19T02:22:46.216ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc88cfcf-0949-4e87-bb70-77adef140782", "content-length": "2", "date": "Tue, 19 Nov 2024 02:22:45 GMT"} })
77872024-11-19T02:22:46.217ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
77882024-11-19T02:22:46.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
77892024-11-19T02:22:46.219ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = 0e468a05-305f-4967-967c-0e29db19974e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
77902024-11-19T02:22:46.220ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = 0e468a05-305f-4967-967c-0e29db19974e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
77912024-11-19T02:22:46.282ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
77922024-11-19T02:22:46.282ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "ef50ebc0-6cd0-4f27-978a-66f06c814825", "date": "Tue, 19 Nov 2024 02:22:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
77932024-11-19T02:22:46.282ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
77942024-11-19T02:22:46.284ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "9e151c6b-866a-4a36-8dd9-ad6ac02d074a", "date": "Tue, 19 Nov 2024 02:22:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
77952024-11-19T02:22:46.285ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
77962024-11-19T02:22:46.286ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
77972024-11-19T02:22:46.286ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 560.446925ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
77982024-11-19T02:22:46.298ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
77992024-11-19T02:22:46.298ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "7610ca09-3a92-4fdb-aa21-43160966960f", "content-length": "691", "date": "Tue, 19 Nov 2024 02:22:46 GMT"} })
78002024-11-19T02:22:46.298ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
78012024-11-19T02:22:46.298ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
78022024-11-19T02:22:46.298ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
78032024-11-19T02:22:46.300ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 573.075879ms iteration = 28 status = {}
78042024-11-19T02:22:46.301ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 574.82205ms iteration = 27 status = null
78052024-11-19T02:22:46.301ZINFOnexus (BackgroundTasks): VPC route manager sled ffe74824-0c08-48e1-a755-fb123e8dc181 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
78062024-11-19T02:22:46.301ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
78072024-11-19T02:22:46.302ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82235 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = 0e468a05-305f-4967-967c-0e29db19974e response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
78082024-11-19T02:22:46.302ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b843457a-1296-4b82-b5e7-0e8eac4abcee", "date": "Tue, 19 Nov 2024 02:22:46 GMT"} })
78092024-11-19T02:22:46.304ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 577.48878ms iteration = 29 status = {}
78102024-11-19T02:22:46.320ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
78112024-11-19T02:22:46.322ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 595.952251ms iteration = 27 status = {}
78122024-11-19T02:22:46.379ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
78132024-11-19T02:22:46.379ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "d989631d-9c25-45c6-88c1-3c4c97d424da", "date": "Tue, 19 Nov 2024 02:22:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
78142024-11-19T02:22:46.379ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
78152024-11-19T02:22:46.382ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "d0e3a618-f9b7-40b6-af93-0f7b081d05a0", "date": "Tue, 19 Nov 2024 02:22:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
78162024-11-19T02:22:46.382ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
78172024-11-19T02:22:46.384ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "55e1ce54-a9c5-44a7-aa26-40b70df7c27e", "date": "Tue, 19 Nov 2024 02:22:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
78182024-11-19T02:22:46.384ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
78192024-11-19T02:22:46.386ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
78202024-11-19T02:22:46.386ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 660.390629ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
78212024-11-19T02:22:46.393ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78222024-11-19T02:22:46.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78232024-11-19T02:22:46.396ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 20bc3881-e2ee-4d8d-b84b-b0c1e478721f, rack_id: a894e92e-d765-4f15-b6b7-cb9ca46d1860, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8597d802-6d4d-4493-88de-333a1f340c20) } rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0
78242024-11-19T02:22:46.396ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78252024-11-19T02:22:46.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78262024-11-19T02:22:46.406ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
78272024-11-19T02:22:46.406ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "c548f844-3781-42b7-b578-2debee542f23", "content-length": "134", "date": "Tue, 19 Nov 2024 02:22:46 GMT"} })
78282024-11-19T02:22:46.406ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
78292024-11-19T02:22:46.406ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8597d802-6d4d-4493-88de-333a1f340c20
78302024-11-19T02:22:46.406ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
78312024-11-19T02:22:46.406ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
78322024-11-19T02:22:46.406ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
78332024-11-19T02:22:46.406ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
78342024-11-19T02:22:46.406ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
78352024-11-19T02:22:46.406ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
78362024-11-19T02:22:46.406ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
78372024-11-19T02:22:46.407ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
78382024-11-19T02:22:46.407ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
78392024-11-19T02:22:46.407ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78402024-11-19T02:22:46.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78412024-11-19T02:22:46.409ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
78422024-11-19T02:22:46.409ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec408d7c-0c62-4b34-8bf4-eaff558e48d2", "content-length": "2", "date": "Tue, 19 Nov 2024 02:22:46 GMT"} })
78432024-11-19T02:22:46.409ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
78442024-11-19T02:22:46.409ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "9acd1716-87ee-4045-9019-96d549c59eff", "content-length": "52", "date": "Tue, 19 Nov 2024 02:22:46 GMT"} })
78452024-11-19T02:22:46.409ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0
78462024-11-19T02:22:46.409ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
78472024-11-19T02:22:46.590ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "c75fe744-c77a-4b89-a3d5-8c8171509942", "date": "Tue, 19 Nov 2024 02:22:46 GMT"} })
78482024-11-19T02:22:46.590ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch = Switch0
78492024-11-19T02:22:46.590ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
78502024-11-19T02:22:46.591ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f3eb4fd-9c55-4857-bd25-4d5bba58c492", "content-length": "682", "date": "Tue, 19 Nov 2024 02:22:46 GMT"} })
78512024-11-19T02:22:46.591ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78522024-11-19T02:22:46.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78532024-11-19T02:22:46.594ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78542024-11-19T02:22:46.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78552024-11-19T02:22:46.598ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78562024-11-19T02:22:46.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78572024-11-19T02:22:46.600ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78582024-11-19T02:22:46.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78592024-11-19T02:22:46.608ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 880.740371ms iteration = 27 status = {}
78602024-11-19T02:22:47.141ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 66a3840c-7dfb-4109-852f-b0788751cee8 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
78612024-11-19T02:22:47.141ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 66a3840c-7dfb-4109-852f-b0788751cee8 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
78622024-11-19T02:22:47.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2153 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 66a3840c-7dfb-4109-852f-b0788751cee8 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
78632024-11-19T02:22:48.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 384e8688-58d7-4bd7-97a5-683bf14e04ce roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
78642024-11-19T02:22:48.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 384e8688-58d7-4bd7-97a5-683bf14e04ce resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
78652024-11-19T02:22:48.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2558 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 384e8688-58d7-4bd7-97a5-683bf14e04ce response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
78662024-11-19T02:22:49.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b255ac13-4cd6-438e-a694-d80697db01f6 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
78672024-11-19T02:22:49.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b255ac13-4cd6-438e-a694-d80697db01f6 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
78682024-11-19T02:22:49.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2295 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b255ac13-4cd6-438e-a694-d80697db01f6 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
78692024-11-19T02:22:50.211ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d86e6d44-ec7e-4137-9a2b-b35ea627ea9b roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
78702024-11-19T02:22:50.212ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d86e6d44-ec7e-4137-9a2b-b35ea627ea9b resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
78712024-11-19T02:22:50.214ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2557 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d86e6d44-ec7e-4137-9a2b-b35ea627ea9b response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
78722024-11-19T02:22:51.235ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 1e8f14cd-d3bd-4a71-8da6-5f444faa8742 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
78732024-11-19T02:22:51.236ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 1e8f14cd-d3bd-4a71-8da6-5f444faa8742 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
78742024-11-19T02:22:51.238ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2690 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 1e8f14cd-d3bd-4a71-8da6-5f444faa8742 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
78752024-11-19T02:22:52.156ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1792 local_addr = [fd00:1122:3344:101::c]:60807 method = GET remote_addr = [fd00:1122:3344:101::d]:57844 req_id = 0ba0683e-fa2b-4143-93f1-b2495f365f73 response_code = 200 uri = /9f0b435f-0000-451e-9dbc-dcec71543c30
78762024-11-19T02:22:52.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 069dd04a-4d76-45b3-8f65-7f317c06def3 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
78772024-11-19T02:22:52.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 069dd04a-4d76-45b3-8f65-7f317c06def3 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
78782024-11-19T02:22:52.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2600 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 069dd04a-4d76-45b3-8f65-7f317c06def3 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
78792024-11-19T02:22:53.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4866e90c-3b12-4dd9-a636-535ab808efc5 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
78802024-11-19T02:22:53.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4866e90c-3b12-4dd9-a636-535ab808efc5 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
78812024-11-19T02:22:53.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2424 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4866e90c-3b12-4dd9-a636-535ab808efc5 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
78822024-11-19T02:22:54.308ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = eb31790d-02e5-4b04-927d-ce13ecb1cfad roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
78832024-11-19T02:22:54.308ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = eb31790d-02e5-4b04-927d-ce13ecb1cfad resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
78842024-11-19T02:22:54.310ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2138 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = eb31790d-02e5-4b04-927d-ce13ecb1cfad response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
78852024-11-19T02:22:55.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = f9f7b2b6-7964-4687-b190-f805e2ace4c9 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
78862024-11-19T02:22:55.333ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = f9f7b2b6-7964-4687-b190-f805e2ace4c9 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
78872024-11-19T02:22:55.335ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2482 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = f9f7b2b6-7964-4687-b190-f805e2ace4c9 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
78882024-11-19T02:22:55.727ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
78892024-11-19T02:22:55.727ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
78902024-11-19T02:22:55.727ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78912024-11-19T02:22:55.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78922024-11-19T02:22:55.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78932024-11-19T02:22:55.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78942024-11-19T02:22:55.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78952024-11-19T02:22:55.730ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78962024-11-19T02:22:55.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78972024-11-19T02:22:55.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
78982024-11-19T02:22:55.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78992024-11-19T02:22:55.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79002024-11-19T02:22:55.732ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.165949ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
79012024-11-19T02:22:55.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79022024-11-19T02:22:55.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79032024-11-19T02:22:55.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79042024-11-19T02:22:55.739ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
79052024-11-19T02:22:55.739ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79062024-11-19T02:22:55.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79072024-11-19T02:22:55.751ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
79082024-11-19T02:22:55.751ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.871853ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
79092024-11-19T02:22:56.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3f4ce0c8-0bd7-44b8-a33b-b71dbd3c2e59 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
79102024-11-19T02:22:56.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3f4ce0c8-0bd7-44b8-a33b-b71dbd3c2e59 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
79112024-11-19T02:22:56.359ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1820 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3f4ce0c8-0bd7-44b8-a33b-b71dbd3c2e59 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
79122024-11-19T02:22:57.148ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = e6b61a6c-82cc-4f7e-beb9-6fd8a89630ad roles = RoleSet { roles: {} } uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?sort_by=id_ascending
79132024-11-19T02:22:57.148ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = e6b61a6c-82cc-4f7e-beb9-6fd8a89630ad resource = Database result = Ok(()) uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?sort_by=id_ascending
79142024-11-19T02:22:57.151ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3261 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = e6b61a6c-82cc-4f7e-beb9-6fd8a89630ad response_code = 200 uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?sort_by=id_ascending
79152024-11-19T02:22:57.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = d65a174f-95a9-4e20-a2e1-fd6dc669df1b roles = RoleSet { roles: {} } uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZmU3NDgyNC0wYzA4LTQ4ZTEtYTc1NS1mYjEyM2U4ZGMxODEifX0%3D
79162024-11-19T02:22:57.152ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = d65a174f-95a9-4e20-a2e1-fd6dc669df1b resource = Database result = Ok(()) uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZmU3NDgyNC0wYzA4LTQ4ZTEtYTc1NS1mYjEyM2U4ZGMxODEifX0%3D
79172024-11-19T02:22:57.154ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2742 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = d65a174f-95a9-4e20-a2e1-fd6dc669df1b response_code = 200 uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZmU3NDgyNC0wYzA4LTQ4ZTEtYTc1NS1mYjEyM2U4ZGMxODEifX0%3D
79182024-11-19T02:22:57.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 7305c471-71f7-4deb-8901-5bedc431a396 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
79192024-11-19T02:22:57.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 7305c471-71f7-4deb-8901-5bedc431a396 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
79202024-11-19T02:22:57.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2499 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 7305c471-71f7-4deb-8901-5bedc431a396 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
79212024-11-19T02:22:58.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b6ee3b7d-c9f1-41ad-a0a5-123e8b7343b6 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
79222024-11-19T02:22:58.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b6ee3b7d-c9f1-41ad-a0a5-123e8b7343b6 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
79232024-11-19T02:22:58.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2322 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b6ee3b7d-c9f1-41ad-a0a5-123e8b7343b6 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
79242024-11-19T02:22:59.431ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = db0b41f8-5639-4478-ae2c-1dac50286feb roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
79252024-11-19T02:22:59.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = db0b41f8-5639-4478-ae2c-1dac50286feb resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
79262024-11-19T02:22:59.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2830 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = db0b41f8-5639-4478-ae2c-1dac50286feb response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
79272024-11-19T02:23:00.428ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
79282024-11-19T02:23:00.428ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
79292024-11-19T02:23:00.458ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
79302024-11-19T02:23:00.458ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:54078
79312024-11-19T02:23:00.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 76e981a1-6ac4-4632-abe7-48bb822210a3 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
79322024-11-19T02:23:00.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:54078 req_id = d0c5f437-37fb-42da-a589-0e3994762406 roles = RoleSet { roles: {} } uri = /metrics/producers
79332024-11-19T02:23:00.458ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 76e981a1-6ac4-4632-abe7-48bb822210a3 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
79342024-11-19T02:23:00.458ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:54078 req_id = d0c5f437-37fb-42da-a589-0e3994762406 resource = Database result = Ok(()) uri = /metrics/producers
79352024-11-19T02:23:00.460ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2231 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 76e981a1-6ac4-4632-abe7-48bb822210a3 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
79362024-11-19T02:23:00.503ZINFOnexus: assigned collector to new producer collector_id = 3980dd20-a3be-40d3-b9e5-094b8ed4b785 file = nexus/src/app/oximeter.rs:76 producer_id = 9f0b435f-0000-451e-9dbc-dcec71543c30
79372024-11-19T02:23:00.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45736 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:54078 req_id = d0c5f437-37fb-42da-a589-0e3994762406 response_code = 201 uri = /metrics/producers
79382024-11-19T02:23:00.504ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "d0c5f437-37fb-42da-a589-0e3994762406", "content-length": "41", "date": "Tue, 19 Nov 2024 02:23:00 GMT"} })
79392024-11-19T02:23:00.505ZDEBGnexus (producer-registration-task): registered with nexus successfully
79402024-11-19T02:23:00.505ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
79412024-11-19T02:23:01.486ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 5a73f46d-08b5-485f-8f1d-0c052eefc363 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
79422024-11-19T02:23:01.486ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 5a73f46d-08b5-485f-8f1d-0c052eefc363 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
79432024-11-19T02:23:01.488ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2550 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 5a73f46d-08b5-485f-8f1d-0c052eefc363 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
79442024-11-19T02:23:02.511ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 2b902023-6155-406b-8908-34298fd4b829 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
79452024-11-19T02:23:02.511ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 2b902023-6155-406b-8908-34298fd4b829 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
79462024-11-19T02:23:02.513ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2965 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 2b902023-6155-406b-8908-34298fd4b829 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
79472024-11-19T02:23:03.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ff349224-4780-4314-846e-a54f28b8fb97 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
79482024-11-19T02:23:03.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ff349224-4780-4314-846e-a54f28b8fb97 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
79492024-11-19T02:23:03.538ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2701 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ff349224-4780-4314-846e-a54f28b8fb97 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
79502024-11-19T02:23:04.560ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = bf73f44d-ddf8-43d4-9581-674b73dd5e9d roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
79512024-11-19T02:23:04.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = bf73f44d-ddf8-43d4-9581-674b73dd5e9d resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
79522024-11-19T02:23:04.562ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2253 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = bf73f44d-ddf8-43d4-9581-674b73dd5e9d response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
79532024-11-19T02:23:05.585ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4b4be22c-3acf-49ba-8d5d-b8419d1894ca roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
79542024-11-19T02:23:05.585ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4b4be22c-3acf-49ba-8d5d-b8419d1894ca resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
79552024-11-19T02:23:05.587ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2245 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4b4be22c-3acf-49ba-8d5d-b8419d1894ca response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
79562024-11-19T02:23:05.728ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
79572024-11-19T02:23:05.728ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
79582024-11-19T02:23:05.728ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79592024-11-19T02:23:05.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79602024-11-19T02:23:05.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79612024-11-19T02:23:05.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79622024-11-19T02:23:05.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79632024-11-19T02:23:05.731ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79642024-11-19T02:23:05.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79652024-11-19T02:23:05.733ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.566132ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
79662024-11-19T02:23:05.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
79672024-11-19T02:23:05.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79682024-11-19T02:23:05.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79692024-11-19T02:23:05.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79702024-11-19T02:23:05.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79712024-11-19T02:23:05.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79722024-11-19T02:23:05.739ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
79732024-11-19T02:23:05.739ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79742024-11-19T02:23:05.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79752024-11-19T02:23:05.754ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
79762024-11-19T02:23:05.754ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.624883ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
79772024-11-19T02:23:06.610ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6877370c-d7e0-49ea-9348-515da475bad9 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
79782024-11-19T02:23:06.610ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6877370c-d7e0-49ea-9348-515da475bad9 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
79792024-11-19T02:23:06.612ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2298 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6877370c-d7e0-49ea-9348-515da475bad9 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
79802024-11-19T02:23:07.158ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1567 local_addr = [fd00:1122:3344:101::c]:60807 method = GET remote_addr = [fd00:1122:3344:101::d]:57844 req_id = a3bf12c7-5428-4762-999d-a66779497edc response_code = 200 uri = /9f0b435f-0000-451e-9dbc-dcec71543c30
79812024-11-19T02:23:07.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 99b9d3d5-b0f1-4514-af6b-1195aed63d55 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
79822024-11-19T02:23:07.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 99b9d3d5-b0f1-4514-af6b-1195aed63d55 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
79832024-11-19T02:23:07.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2248 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 99b9d3d5-b0f1-4514-af6b-1195aed63d55 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
79842024-11-19T02:23:08.659ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3c460a61-d133-40da-bf27-589f3a98340a roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
79852024-11-19T02:23:08.659ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3c460a61-d133-40da-bf27-589f3a98340a resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
79862024-11-19T02:23:08.661ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2216 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3c460a61-d133-40da-bf27-589f3a98340a response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
79872024-11-19T02:23:09.683ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 7b5019d5-9009-4c04-826c-1f883abbe844 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
79882024-11-19T02:23:09.683ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 7b5019d5-9009-4c04-826c-1f883abbe844 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
79892024-11-19T02:23:09.685ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1722 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 7b5019d5-9009-4c04-826c-1f883abbe844 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
79902024-11-19T02:23:10.707ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = bcfa471b-8652-4857-93d1-26312f7dd7b6 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
79912024-11-19T02:23:10.707ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = bcfa471b-8652-4857-93d1-26312f7dd7b6 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
79922024-11-19T02:23:10.709ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2284 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = bcfa471b-8652-4857-93d1-26312f7dd7b6 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
79932024-11-19T02:23:11.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6da50c76-6016-4b5d-95b6-871b8031a586 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
79942024-11-19T02:23:11.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6da50c76-6016-4b5d-95b6-871b8031a586 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
79952024-11-19T02:23:11.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2219 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6da50c76-6016-4b5d-95b6-871b8031a586 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
79962024-11-19T02:23:12.755ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4162cacd-4d81-4d44-abd1-070c5c019abd roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
79972024-11-19T02:23:12.755ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4162cacd-4d81-4d44-abd1-070c5c019abd resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
79982024-11-19T02:23:12.757ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2712 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4162cacd-4d81-4d44-abd1-070c5c019abd response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
79992024-11-19T02:23:13.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 443d45c9-ff71-476e-96a6-409ca529853b roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
80002024-11-19T02:23:13.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 443d45c9-ff71-476e-96a6-409ca529853b resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
80012024-11-19T02:23:13.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2497 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 443d45c9-ff71-476e-96a6-409ca529853b response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
80022024-11-19T02:23:14.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c5963dc5-6b4a-4d1d-967c-25d9f0258745 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
80032024-11-19T02:23:14.805ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c5963dc5-6b4a-4d1d-967c-25d9f0258745 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
80042024-11-19T02:23:14.807ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1821 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c5963dc5-6b4a-4d1d-967c-25d9f0258745 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
80052024-11-19T02:23:15.727ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 28 reason = Timeout
80062024-11-19T02:23:15.727ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
80072024-11-19T02:23:15.727ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 28 reason = Timeout
80082024-11-19T02:23:15.727ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
80092024-11-19T02:23:15.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
80102024-11-19T02:23:15.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
80112024-11-19T02:23:15.728ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 28 reason = Timeout
80122024-11-19T02:23:15.728ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 28 reason = Timeout
80132024-11-19T02:23:15.728ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
80142024-11-19T02:23:15.728ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80152024-11-19T02:23:15.728ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 30 reason = Timeout
80162024-11-19T02:23:15.728ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 28 reason = Timeout
80172024-11-19T02:23:15.728ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
80182024-11-19T02:23:15.728ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
80192024-11-19T02:23:15.728ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80202024-11-19T02:23:15.728ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 28 reason = Timeout
80212024-11-19T02:23:15.728ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
80222024-11-19T02:23:15.728ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 28 reason = Timeout
80232024-11-19T02:23:15.728ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 32 reason = Timeout
80242024-11-19T02:23:15.728ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
80252024-11-19T02:23:15.728ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80262024-11-19T02:23:15.728ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 28 reason = Timeout
80272024-11-19T02:23:15.728ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
80282024-11-19T02:23:15.728ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 82 reason = Timeout
80292024-11-19T02:23:15.728ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80302024-11-19T02:23:15.728ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 29 reason = Timeout
80312024-11-19T02:23:15.728ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80322024-11-19T02:23:15.728ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 28 reason = Timeout
80332024-11-19T02:23:15.728ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 28 reason = Timeout
80342024-11-19T02:23:15.728ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 28 reason = Timeout
80352024-11-19T02:23:15.728ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
80362024-11-19T02:23:15.728ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 82 reason = Timeout
80372024-11-19T02:23:15.728ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80382024-11-19T02:23:15.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80392024-11-19T02:23:15.728ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
80402024-11-19T02:23:15.728ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
80412024-11-19T02:23:15.728ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
80422024-11-19T02:23:15.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
80432024-11-19T02:23:15.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80442024-11-19T02:23:15.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
80452024-11-19T02:23:15.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80462024-11-19T02:23:15.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80472024-11-19T02:23:15.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
80482024-11-19T02:23:15.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
80492024-11-19T02:23:15.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80502024-11-19T02:23:15.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
80512024-11-19T02:23:15.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80522024-11-19T02:23:15.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
80532024-11-19T02:23:15.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80542024-11-19T02:23:15.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
80552024-11-19T02:23:15.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80562024-11-19T02:23:15.730ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1693, tv_nsec: 512198664 } })
80572024-11-19T02:23:15.730ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1693, tv_nsec: 512532158 } })
80582024-11-19T02:23:15.730ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
80592024-11-19T02:23:15.730ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
80602024-11-19T02:23:15.731ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80612024-11-19T02:23:15.731ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80622024-11-19T02:23:15.731ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.423359ms iteration = 28 status = {"errors":[],"records_set_to_done":[]}
80632024-11-19T02:23:15.732ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.675422ms iteration = 28 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
80642024-11-19T02:23:15.732ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80652024-11-19T02:23:15.733ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80662024-11-19T02:23:15.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
80672024-11-19T02:23:15.734ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
80682024-11-19T02:23:15.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
80692024-11-19T02:23:15.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
80702024-11-19T02:23:15.735ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80712024-11-19T02:23:15.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80722024-11-19T02:23:15.735ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
80732024-11-19T02:23:15.735ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80742024-11-19T02:23:15.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80752024-11-19T02:23:15.736ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
80762024-11-19T02:23:15.736ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80772024-11-19T02:23:15.736ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
80782024-11-19T02:23:15.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80792024-11-19T02:23:15.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
80802024-11-19T02:23:15.737ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.058764ms iteration = 28 status = {"errors":[],"garbage_collect_requested":[]}
80812024-11-19T02:23:15.737ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80822024-11-19T02:23:15.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80832024-11-19T02:23:15.738ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80842024-11-19T02:23:15.739ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80852024-11-19T02:23:15.740ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
80862024-11-19T02:23:15.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
80872024-11-19T02:23:15.742ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
80882024-11-19T02:23:15.742ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80892024-11-19T02:23:15.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80902024-11-19T02:23:15.742ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
80912024-11-19T02:23:15.743ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80922024-11-19T02:23:15.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80932024-11-19T02:23:15.744ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80942024-11-19T02:23:15.744ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80952024-11-19T02:23:15.745ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1693, tv_nsec: 527074594 } })
80962024-11-19T02:23:15.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80972024-11-19T02:23:15.745ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
80982024-11-19T02:23:15.746ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 17.643511ms iteration = 82 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
80992024-11-19T02:23:15.746ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 18.013986ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
81002024-11-19T02:23:15.747ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
81012024-11-19T02:23:15.747ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81022024-11-19T02:23:15.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81032024-11-19T02:23:15.748ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81042024-11-19T02:23:15.748ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
81052024-11-19T02:23:15.748ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 19.982579ms iteration = 28 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
81062024-11-19T02:23:15.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81072024-11-19T02:23:15.749ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81082024-11-19T02:23:15.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81092024-11-19T02:23:15.749ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81102024-11-19T02:23:15.750ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81112024-11-19T02:23:15.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81122024-11-19T02:23:15.751ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81132024-11-19T02:23:15.752ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
81142024-11-19T02:23:15.752ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81152024-11-19T02:23:15.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81162024-11-19T02:23:15.754ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
81172024-11-19T02:23:15.754ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81182024-11-19T02:23:15.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81192024-11-19T02:23:15.757ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81202024-11-19T02:23:15.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81212024-11-19T02:23:15.759ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81222024-11-19T02:23:15.761ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
81232024-11-19T02:23:15.761ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81242024-11-19T02:23:15.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81252024-11-19T02:23:15.773ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
81262024-11-19T02:23:15.773ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
81272024-11-19T02:23:15.773ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
81282024-11-19T02:23:15.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
81292024-11-19T02:23:15.777ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
81302024-11-19T02:23:15.777ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
81312024-11-19T02:23:15.777ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
81322024-11-19T02:23:15.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
81332024-11-19T02:23:15.779ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81342024-11-19T02:23:15.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81352024-11-19T02:23:15.779ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
81362024-11-19T02:23:15.779ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 51.289217ms iteration = 82 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
81372024-11-19T02:23:15.780ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81382024-11-19T02:23:15.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81392024-11-19T02:23:15.781ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
81402024-11-19T02:23:15.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
81412024-11-19T02:23:15.782ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81422024-11-19T02:23:15.785ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: ffe74824-0c08-48e1-a755-fb123e8dc181, lookup_type: ById(ffe74824-0c08-48e1-a755-fb123e8dc181) } result = Ok(())
81432024-11-19T02:23:15.785ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81442024-11-19T02:23:15.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81452024-11-19T02:23:15.786ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
81462024-11-19T02:23:15.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
81472024-11-19T02:23:15.787ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 58.865624ms iteration = 28 status = 0
81482024-11-19T02:23:15.788ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 59.844635ms iteration = 28 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
81492024-11-19T02:23:15.800ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81502024-11-19T02:23:15.802ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
81512024-11-19T02:23:15.802ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81522024-11-19T02:23:15.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81532024-11-19T02:23:15.803ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 75.314412ms iteration = 32 status = {"physical_disks_added":0}
81542024-11-19T02:23:15.818ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
81552024-11-19T02:23:15.818ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
81562024-11-19T02:23:15.818ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 90.269914ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
81572024-11-19T02:23:15.818ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 90.391245ms iteration = 28 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
81582024-11-19T02:23:15.825ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
81592024-11-19T02:23:15.825ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
81602024-11-19T02:23:15.825ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "aa59c563-3c08-4947-9c08-2cc4f6afb2ff", "content-length": "26", "date": "Tue, 19 Nov 2024 02:23:15 GMT"} })
81612024-11-19T02:23:15.825ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
81622024-11-19T02:23:15.827ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
81632024-11-19T02:23:15.829ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 81b5022b-4b3b-4cb1-b1d0-7c6e4c4ea04e roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
81642024-11-19T02:23:15.829ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 81b5022b-4b3b-4cb1-b1d0-7c6e4c4ea04e resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
81652024-11-19T02:23:15.835ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
81662024-11-19T02:23:15.835ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
81672024-11-19T02:23:15.835ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b998d110-81a8-4bde-9d9e-e6a564a05184", "content-length": "26", "date": "Tue, 19 Nov 2024 02:23:15 GMT"} })
81682024-11-19T02:23:15.835ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
81692024-11-19T02:23:15.837ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
81702024-11-19T02:23:15.860ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 zone_address = fd00:1122:3344:101::2
81712024-11-19T02:23:15.860ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
81722024-11-19T02:23:15.860ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9212309a-7f21-4185-9ca0-84dd78c7284e", "content-length": "26", "date": "Tue, 19 Nov 2024 02:23:15 GMT"} })
81732024-11-19T02:23:15.860ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
81742024-11-19T02:23:15.862ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
81752024-11-19T02:23:15.958ZINFOnexus (BackgroundTasks): VPC route manager sled ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
81762024-11-19T02:23:15.958ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
81772024-11-19T02:23:15.959ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "93ba9179-9818-4969-9c97-3b0ef5b8cb14", "content-length": "372", "date": "Tue, 19 Nov 2024 02:23:15 GMT"} })
81782024-11-19T02:23:15.959ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81792024-11-19T02:23:15.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81802024-11-19T02:23:15.961ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132120 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 81b5022b-4b3b-4cb1-b1d0-7c6e4c4ea04e response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
81812024-11-19T02:23:15.976ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
81822024-11-19T02:23:15.976ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
81832024-11-19T02:23:15.976ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d585e4b8-dc07-4624-856f-37952bbb3bc9", "date": "Tue, 19 Nov 2024 02:23:15 GMT"} })
81842024-11-19T02:23:15.976ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81852024-11-19T02:23:15.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81862024-11-19T02:23:15.982ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81872024-11-19T02:23:15.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81882024-11-19T02:23:15.985ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81892024-11-19T02:23:15.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81902024-11-19T02:23:16.010ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
81912024-11-19T02:23:16.010ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "90b46eaf-5f19-49ce-9786-9ee8081ca57e", "content-length": "691", "date": "Tue, 19 Nov 2024 02:23:15 GMT"} })
81922024-11-19T02:23:16.010ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
81932024-11-19T02:23:16.010ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
81942024-11-19T02:23:16.010ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
81952024-11-19T02:23:16.012ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 284.202593ms iteration = 29 status = {}
81962024-11-19T02:23:16.014ZINFOnexus (BackgroundTasks): VPC route manager sled ffe74824-0c08-48e1-a755-fb123e8dc181 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
81972024-11-19T02:23:16.014ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
81982024-11-19T02:23:16.014ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "65a9a1bb-8c28-4b1d-b726-5e40a5924692", "date": "Tue, 19 Nov 2024 02:23:15 GMT"} })
81992024-11-19T02:23:16.016ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 288.060208ms iteration = 30 status = {}
82002024-11-19T02:23:16.074ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
82012024-11-19T02:23:16.074ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "084dcacb-a859-425c-a97b-743ac1a1c2ec", "content-length": "2", "date": "Tue, 19 Nov 2024 02:23:15 GMT"} })
82022024-11-19T02:23:16.077ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
82032024-11-19T02:23:16.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
82042024-11-19T02:23:16.078ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 350.905727ms iteration = 28 status = {}
82052024-11-19T02:23:16.080ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 352.782409ms iteration = 28 status = null
82062024-11-19T02:23:16.129ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82072024-11-19T02:23:16.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82082024-11-19T02:23:16.132ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 20bc3881-e2ee-4d8d-b84b-b0c1e478721f, rack_id: a894e92e-d765-4f15-b6b7-cb9ca46d1860, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8597d802-6d4d-4493-88de-333a1f340c20) } rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0
82092024-11-19T02:23:16.132ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82102024-11-19T02:23:16.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82112024-11-19T02:23:16.150ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
82122024-11-19T02:23:16.151ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b82447a1-1642-4478-b181-1802b5c02f70", "content-length": "134", "date": "Tue, 19 Nov 2024 02:23:15 GMT"} })
82132024-11-19T02:23:16.151ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
82142024-11-19T02:23:16.151ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8597d802-6d4d-4493-88de-333a1f340c20
82152024-11-19T02:23:16.151ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
82162024-11-19T02:23:16.151ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
82172024-11-19T02:23:16.151ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
82182024-11-19T02:23:16.151ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
82192024-11-19T02:23:16.151ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
82202024-11-19T02:23:16.151ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
82212024-11-19T02:23:16.151ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
82222024-11-19T02:23:16.151ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
82232024-11-19T02:23:16.151ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
82242024-11-19T02:23:16.151ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82252024-11-19T02:23:16.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82262024-11-19T02:23:16.154ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
82272024-11-19T02:23:16.154ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca0678c4-3572-4129-bf48-c26a07500cd3", "content-length": "2", "date": "Tue, 19 Nov 2024 02:23:15 GMT"} })
82282024-11-19T02:23:16.154ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
82292024-11-19T02:23:16.154ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "c94d9f2d-9410-4be3-9a32-c697a58a4811", "content-length": "52", "date": "Tue, 19 Nov 2024 02:23:15 GMT"} })
82302024-11-19T02:23:16.154ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0
82312024-11-19T02:23:16.154ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
82322024-11-19T02:23:16.274ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "3c49ab65-907f-467c-9a5c-20181f21378e", "date": "Tue, 19 Nov 2024 02:23:15 GMT"} })
82332024-11-19T02:23:16.274ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch = Switch0
82342024-11-19T02:23:16.274ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
82352024-11-19T02:23:16.274ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b5d13dbe-f63f-4da8-ad92-a2b1122679e6", "content-length": "682", "date": "Tue, 19 Nov 2024 02:23:15 GMT"} })
82362024-11-19T02:23:16.274ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82372024-11-19T02:23:16.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82382024-11-19T02:23:16.278ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82392024-11-19T02:23:16.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82402024-11-19T02:23:16.281ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82412024-11-19T02:23:16.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82422024-11-19T02:23:16.284ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82432024-11-19T02:23:16.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82442024-11-19T02:23:16.291ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 563.581061ms iteration = 28 status = {}
82452024-11-19T02:23:16.334ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = d06486b2-e3d3-48f9-84d0-d07fdbe550ee roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
82462024-11-19T02:23:16.334ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = d06486b2-e3d3-48f9-84d0-d07fdbe550ee resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
82472024-11-19T02:23:16.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3542 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = d06486b2-e3d3-48f9-84d0-d07fdbe550ee response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
82482024-11-19T02:23:16.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9cec364c-93f0-441d-93ec-0f4d8d9d7046 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
82492024-11-19T02:23:16.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9cec364c-93f0-441d-93ec-0f4d8d9d7046 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
82502024-11-19T02:23:16.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2658 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9cec364c-93f0-441d-93ec-0f4d8d9d7046 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
82512024-11-19T02:23:18.014ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 169e5636-5b25-463d-8ecd-73539865346b roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
82522024-11-19T02:23:18.014ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 169e5636-5b25-463d-8ecd-73539865346b resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
82532024-11-19T02:23:18.016ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2637 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 169e5636-5b25-463d-8ecd-73539865346b response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
82542024-11-19T02:23:19.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ae9f024f-9a82-440b-9099-645bac281ef9 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
82552024-11-19T02:23:19.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ae9f024f-9a82-440b-9099-645bac281ef9 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
82562024-11-19T02:23:19.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1821 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ae9f024f-9a82-440b-9099-645bac281ef9 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
82572024-11-19T02:23:20.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 309e7a64-bfef-449f-8f78-fcd80f196d96 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
82582024-11-19T02:23:20.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 309e7a64-bfef-449f-8f78-fcd80f196d96 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
82592024-11-19T02:23:20.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2576 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 309e7a64-bfef-449f-8f78-fcd80f196d96 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
82602024-11-19T02:23:21.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4af0bc1c-8f6c-4a07-8827-96d29f0c4026 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
82612024-11-19T02:23:21.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4af0bc1c-8f6c-4a07-8827-96d29f0c4026 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
82622024-11-19T02:23:21.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2253 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4af0bc1c-8f6c-4a07-8827-96d29f0c4026 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
82632024-11-19T02:23:22.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 1ed7e8df-93fb-4f34-9c16-05bbc2f3ae4e roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
82642024-11-19T02:23:22.115ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 1ed7e8df-93fb-4f34-9c16-05bbc2f3ae4e resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
82652024-11-19T02:23:22.117ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2725 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 1ed7e8df-93fb-4f34-9c16-05bbc2f3ae4e response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
82662024-11-19T02:23:22.157ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1532 local_addr = [fd00:1122:3344:101::c]:60807 method = GET remote_addr = [fd00:1122:3344:101::d]:57844 req_id = 54ced147-8d08-46e4-b262-052132c5c63a response_code = 200 uri = /9f0b435f-0000-451e-9dbc-dcec71543c30
82672024-11-19T02:23:23.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 322882e3-8758-4beb-82e7-b930d4b1ecc1 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
82682024-11-19T02:23:23.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 322882e3-8758-4beb-82e7-b930d4b1ecc1 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
82692024-11-19T02:23:23.141ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2382 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 322882e3-8758-4beb-82e7-b930d4b1ecc1 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
82702024-11-19T02:23:24.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4a3270c0-7153-4c35-b8cc-603c07c4675c roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
82712024-11-19T02:23:24.165ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4a3270c0-7153-4c35-b8cc-603c07c4675c resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
82722024-11-19T02:23:24.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2291 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4a3270c0-7153-4c35-b8cc-603c07c4675c response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
82732024-11-19T02:23:25.189ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6dcfe3c9-ec77-44a9-9698-98317fe98d23 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
82742024-11-19T02:23:25.189ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6dcfe3c9-ec77-44a9-9698-98317fe98d23 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
82752024-11-19T02:23:25.191ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2591 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6dcfe3c9-ec77-44a9-9698-98317fe98d23 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
82762024-11-19T02:23:25.728ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 83 reason = Timeout
82772024-11-19T02:23:25.728ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 83 reason = Timeout
82782024-11-19T02:23:25.728ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82792024-11-19T02:23:25.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82802024-11-19T02:23:25.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82812024-11-19T02:23:25.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82822024-11-19T02:23:25.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82832024-11-19T02:23:25.732ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82842024-11-19T02:23:25.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82852024-11-19T02:23:25.733ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.306821ms iteration = 83 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
82862024-11-19T02:23:25.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
82872024-11-19T02:23:25.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82882024-11-19T02:23:25.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82892024-11-19T02:23:25.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82902024-11-19T02:23:25.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82912024-11-19T02:23:25.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82922024-11-19T02:23:25.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
82932024-11-19T02:23:25.740ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82942024-11-19T02:23:25.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82952024-11-19T02:23:25.750ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
82962024-11-19T02:23:25.750ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.486406ms iteration = 83 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
82972024-11-19T02:23:26.213ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 93fb6f11-a669-4ba3-801b-46ddc0bc6e92 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
82982024-11-19T02:23:26.213ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 93fb6f11-a669-4ba3-801b-46ddc0bc6e92 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
82992024-11-19T02:23:26.215ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2286 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 93fb6f11-a669-4ba3-801b-46ddc0bc6e92 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83002024-11-19T02:23:27.148ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = d17d5664-0bdf-4fb3-a484-db772a8a15b9 roles = RoleSet { roles: {} } uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?sort_by=id_ascending
83012024-11-19T02:23:27.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = d17d5664-0bdf-4fb3-a484-db772a8a15b9 resource = Database result = Ok(()) uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?sort_by=id_ascending
83022024-11-19T02:23:27.151ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3427 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = d17d5664-0bdf-4fb3-a484-db772a8a15b9 response_code = 200 uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?sort_by=id_ascending
83032024-11-19T02:23:27.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = d5b373f8-69d8-48cb-86b4-4ca69544c798 roles = RoleSet { roles: {} } uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZmU3NDgyNC0wYzA4LTQ4ZTEtYTc1NS1mYjEyM2U4ZGMxODEifX0%3D
83042024-11-19T02:23:27.152ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = d5b373f8-69d8-48cb-86b4-4ca69544c798 resource = Database result = Ok(()) uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZmU3NDgyNC0wYzA4LTQ4ZTEtYTc1NS1mYjEyM2U4ZGMxODEifX0%3D
83052024-11-19T02:23:27.154ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2184 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = d5b373f8-69d8-48cb-86b4-4ca69544c798 response_code = 200 uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZmU3NDgyNC0wYzA4LTQ4ZTEtYTc1NS1mYjEyM2U4ZGMxODEifX0%3D
83062024-11-19T02:23:27.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ff2b91bf-3d97-485a-b6fa-e1284492969d roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83072024-11-19T02:23:27.237ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ff2b91bf-3d97-485a-b6fa-e1284492969d resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83082024-11-19T02:23:27.240ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2519 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ff2b91bf-3d97-485a-b6fa-e1284492969d response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83092024-11-19T02:23:28.261ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e96b2010-150e-4fdd-bbf5-302226df7368 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83102024-11-19T02:23:28.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e96b2010-150e-4fdd-bbf5-302226df7368 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83112024-11-19T02:23:28.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2241 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e96b2010-150e-4fdd-bbf5-302226df7368 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83122024-11-19T02:23:29.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ecf7c958-37f5-431c-8dc4-e21e020483f9 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83132024-11-19T02:23:29.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ecf7c958-37f5-431c-8dc4-e21e020483f9 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83142024-11-19T02:23:29.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2532 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ecf7c958-37f5-431c-8dc4-e21e020483f9 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83152024-11-19T02:23:30.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6740116a-d1fe-49c0-b491-25854285292b roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83162024-11-19T02:23:30.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6740116a-d1fe-49c0-b491-25854285292b resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83172024-11-19T02:23:30.314ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2757 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6740116a-d1fe-49c0-b491-25854285292b response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83182024-11-19T02:23:31.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9c058c51-2aba-4f7d-8172-66ca4dd15e89 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83192024-11-19T02:23:31.337ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9c058c51-2aba-4f7d-8172-66ca4dd15e89 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83202024-11-19T02:23:31.341ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4364 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9c058c51-2aba-4f7d-8172-66ca4dd15e89 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83212024-11-19T02:23:32.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a6ec8b68-f841-4e18-a0d6-5e2030540227 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83222024-11-19T02:23:32.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a6ec8b68-f841-4e18-a0d6-5e2030540227 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83232024-11-19T02:23:32.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2747 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a6ec8b68-f841-4e18-a0d6-5e2030540227 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83242024-11-19T02:23:33.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a6956eaf-42c2-4db5-bc92-8098db342a9a roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83252024-11-19T02:23:33.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a6956eaf-42c2-4db5-bc92-8098db342a9a resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83262024-11-19T02:23:33.392ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2757 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a6956eaf-42c2-4db5-bc92-8098db342a9a response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83272024-11-19T02:23:34.414ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 5d3abcd5-7425-470e-a482-a94f0fdba03d roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83282024-11-19T02:23:34.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 5d3abcd5-7425-470e-a482-a94f0fdba03d resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83292024-11-19T02:23:34.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2465 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 5d3abcd5-7425-470e-a482-a94f0fdba03d response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83302024-11-19T02:23:35.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 076c29d8-ba4b-4a90-b385-c642d2998de0 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83312024-11-19T02:23:35.439ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 076c29d8-ba4b-4a90-b385-c642d2998de0 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83322024-11-19T02:23:35.441ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2300 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 076c29d8-ba4b-4a90-b385-c642d2998de0 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83332024-11-19T02:23:35.728ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 84 reason = Timeout
83342024-11-19T02:23:35.728ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 84 reason = Timeout
83352024-11-19T02:23:35.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83362024-11-19T02:23:35.728ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83372024-11-19T02:23:35.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83382024-11-19T02:23:35.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83392024-11-19T02:23:35.730ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83402024-11-19T02:23:35.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83412024-11-19T02:23:35.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83422024-11-19T02:23:35.732ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.936025ms iteration = 84 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
83432024-11-19T02:23:35.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
83442024-11-19T02:23:35.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83452024-11-19T02:23:35.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83462024-11-19T02:23:35.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83472024-11-19T02:23:35.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83482024-11-19T02:23:35.738ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83492024-11-19T02:23:35.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
83502024-11-19T02:23:35.740ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83512024-11-19T02:23:35.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83522024-11-19T02:23:35.752ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
83532024-11-19T02:23:35.752ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.374819ms iteration = 84 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
83542024-11-19T02:23:36.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 85301468-b3b4-4fa5-aebd-3c798ed04bbe roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83552024-11-19T02:23:36.465ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 85301468-b3b4-4fa5-aebd-3c798ed04bbe resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83562024-11-19T02:23:36.466ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1915 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 85301468-b3b4-4fa5-aebd-3c798ed04bbe response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83572024-11-19T02:23:37.157ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1929 local_addr = [fd00:1122:3344:101::c]:60807 method = GET remote_addr = [fd00:1122:3344:101::d]:57844 req_id = ef0ac5e3-f06a-431c-a962-dd13dc34bd23 response_code = 200 uri = /9f0b435f-0000-451e-9dbc-dcec71543c30
83582024-11-19T02:23:37.489ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 17fabcba-796f-4fc9-a830-dc5be96bac2a roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83592024-11-19T02:23:37.489ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 17fabcba-796f-4fc9-a830-dc5be96bac2a resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83602024-11-19T02:23:37.491ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2299 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 17fabcba-796f-4fc9-a830-dc5be96bac2a response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83612024-11-19T02:23:38.514ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 1f689bf1-5958-4bc2-ac8f-4f662a9fc1a9 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83622024-11-19T02:23:38.515ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 1f689bf1-5958-4bc2-ac8f-4f662a9fc1a9 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83632024-11-19T02:23:38.516ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2446 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 1f689bf1-5958-4bc2-ac8f-4f662a9fc1a9 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83642024-11-19T02:23:39.538ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ea53a429-f075-4501-9493-0c12b4dacdc9 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83652024-11-19T02:23:39.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ea53a429-f075-4501-9493-0c12b4dacdc9 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83662024-11-19T02:23:39.540ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2056 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ea53a429-f075-4501-9493-0c12b4dacdc9 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83672024-11-19T02:23:40.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3e3c13d5-35ec-43bc-a20f-6a6ed7a93bde roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83682024-11-19T02:23:40.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3e3c13d5-35ec-43bc-a20f-6a6ed7a93bde resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83692024-11-19T02:23:40.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2369 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3e3c13d5-35ec-43bc-a20f-6a6ed7a93bde response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83702024-11-19T02:23:41.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = aa80b08e-fe48-40a0-8a22-6605ad485e46 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83712024-11-19T02:23:41.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = aa80b08e-fe48-40a0-8a22-6605ad485e46 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83722024-11-19T02:23:41.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2828 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = aa80b08e-fe48-40a0-8a22-6605ad485e46 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83732024-11-19T02:23:42.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 54e92a1b-dea0-4217-afd2-4eb91cc39e52 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83742024-11-19T02:23:42.611ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 54e92a1b-dea0-4217-afd2-4eb91cc39e52 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83752024-11-19T02:23:42.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2708 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 54e92a1b-dea0-4217-afd2-4eb91cc39e52 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83762024-11-19T02:23:43.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 24b0c892-5517-4985-9c7e-1756f0af1baa roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83772024-11-19T02:23:43.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 24b0c892-5517-4985-9c7e-1756f0af1baa resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83782024-11-19T02:23:43.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2596 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 24b0c892-5517-4985-9c7e-1756f0af1baa response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83792024-11-19T02:23:44.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 66cb7dc9-f8ea-435f-bb92-0b6231052605 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83802024-11-19T02:23:44.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 66cb7dc9-f8ea-435f-bb92-0b6231052605 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83812024-11-19T02:23:44.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2442 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 66cb7dc9-f8ea-435f-bb92-0b6231052605 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83822024-11-19T02:23:45.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = 65b88185-d9a7-429d-8cf8-7e4cd4a541ea roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
83832024-11-19T02:23:45.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = 65b88185-d9a7-429d-8cf8-7e4cd4a541ea resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
83842024-11-19T02:23:45.372ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2718 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = 65b88185-d9a7-429d-8cf8-7e4cd4a541ea response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
83852024-11-19T02:23:45.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0e433370-beef-4ed1-a515-79eb846552a4 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83862024-11-19T02:23:45.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0e433370-beef-4ed1-a515-79eb846552a4 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83872024-11-19T02:23:45.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2120 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0e433370-beef-4ed1-a515-79eb846552a4 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
83882024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 29 reason = Timeout
83892024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 85 reason = Timeout
83902024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 31 reason = Timeout
83912024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83922024-11-19T02:23:45.728ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
83932024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83942024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83952024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 15 reason = Timeout
83962024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
83972024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 16 reason = Timeout
83982024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
83992024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
84002024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 16 reason = Timeout
84012024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 29 reason = Timeout
84022024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
84032024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 29 reason = Timeout
84042024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
84052024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 29 reason = Timeout
84062024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
84072024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 29 reason = Timeout
84082024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
84092024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 15 reason = Timeout
84102024-11-19T02:23:45.728ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
84112024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
84122024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 29 reason = Timeout
84132024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 29 reason = Timeout
84142024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
84152024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 85 reason = Timeout
84162024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 16 reason = Timeout
84172024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
84182024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84192024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 29 reason = Timeout
84202024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
84212024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 29 reason = Timeout
84222024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
84232024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
84242024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
84252024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 15 reason = Timeout
84262024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
84272024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 17 reason = Timeout
84282024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 29 reason = Timeout
84292024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
84302024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 30 reason = Timeout
84312024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84322024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 15 reason = Timeout
84332024-11-19T02:23:45.728ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-19 02:13:45.728635671 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
84342024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
84352024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 16 reason = Timeout
84362024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
84372024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 29 reason = Timeout
84382024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
84392024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 17 reason = Timeout
84402024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84412024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 15 reason = Timeout
84422024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 33 reason = Timeout
84432024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
84442024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84452024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 16 reason = Timeout
84462024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 29 reason = Timeout
84472024-11-19T02:23:45.728ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115
84482024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 16 reason = Timeout
84492024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.8\u{b5}s iteration = 16 status = {"enabled":false,"target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115"}
84502024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84512024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84522024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84532024-11-19T02:23:45.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
84542024-11-19T02:23:45.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
84552024-11-19T02:23:45.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
84562024-11-19T02:23:45.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
84572024-11-19T02:23:45.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
84582024-11-19T02:23:45.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
84592024-11-19T02:23:45.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
84602024-11-19T02:23:45.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
84612024-11-19T02:23:45.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
84622024-11-19T02:23:45.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
84632024-11-19T02:23:45.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84642024-11-19T02:23:45.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
84652024-11-19T02:23:45.729ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2d59cdb7-e3b1-4e94-afa3-f64f69928234.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a949a8d8-46c7-4423-b760-c03f98ccf638.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b190a9bf-d8b7-43c3-add4-e113c9b89870.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b190a9bf-d8b7-43c3-add4-e113c9b89870.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1723, tv_nsec: 510652446 } })
84662024-11-19T02:23:45.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
84672024-11-19T02:23:45.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84682024-11-19T02:23:45.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84692024-11-19T02:23:45.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
84702024-11-19T02:23:45.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
84712024-11-19T02:23:45.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
84722024-11-19T02:23:45.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
84732024-11-19T02:23:45.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
84742024-11-19T02:23:45.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84752024-11-19T02:23:45.729ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("27d1a6ca-1b76-4956-aefa-e234c7d60cd0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("91bdcbd0-987b-49c4-8200-fc3e8f332b6b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("91bdcbd0-987b-49c4-8200-fc3e8f332b6b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1723, tv_nsec: 510848058 } })
84762024-11-19T02:23:45.729ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
84772024-11-19T02:23:45.729ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.530788ms iteration = 16 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
84782024-11-19T02:23:45.730ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
84792024-11-19T02:23:45.730ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.256844ms iteration = 16 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
84802024-11-19T02:23:45.730ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84812024-11-19T02:23:45.731ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
84822024-11-19T02:23:45.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
84832024-11-19T02:23:45.731ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84842024-11-19T02:23:45.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84852024-11-19T02:23:45.732ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.170748ms iteration = 29 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
84862024-11-19T02:23:45.733ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
84872024-11-19T02:23:45.733ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84882024-11-19T02:23:45.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84892024-11-19T02:23:45.733ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 4.991337ms iteration = 15 status = {"errors":[],"found_port_ok":[]}
84902024-11-19T02:23:45.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
84912024-11-19T02:23:45.734ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84922024-11-19T02:23:45.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84932024-11-19T02:23:45.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
84942024-11-19T02:23:45.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84952024-11-19T02:23:45.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84962024-11-19T02:23:45.735ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 7.459245ms iteration = 29 status = {"errors":[],"garbage_collect_requested":[]}
84972024-11-19T02:23:45.735ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1723, tv_nsec: 517360373 } })
84982024-11-19T02:23:45.736ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
84992024-11-19T02:23:45.737ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1723, tv_nsec: 518919861 } })
85002024-11-19T02:23:45.737ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
85012024-11-19T02:23:45.737ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
85022024-11-19T02:23:45.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
85032024-11-19T02:23:45.738ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85042024-11-19T02:23:45.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
85052024-11-19T02:23:45.740ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
85062024-11-19T02:23:45.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
85072024-11-19T02:23:45.741ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-19 02:13:45.728635671 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
85082024-11-19T02:23:45.741ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 12.468793ms iteration = 15 status = {"expiration":"2024-11-19T02:13:45.728635671Z","pruned":[]}
85092024-11-19T02:23:45.742ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85102024-11-19T02:23:45.743ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85112024-11-19T02:23:45.744ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
85122024-11-19T02:23:45.744ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
85132024-11-19T02:23:45.744ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 15.475117ms iteration = 15 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
85142024-11-19T02:23:45.746ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
85152024-11-19T02:23:45.746ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85162024-11-19T02:23:45.746ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
85172024-11-19T02:23:45.746ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
85182024-11-19T02:23:45.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85192024-11-19T02:23:45.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
85202024-11-19T02:23:45.748ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85212024-11-19T02:23:45.750ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85222024-11-19T02:23:45.750ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85232024-11-19T02:23:45.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85242024-11-19T02:23:45.751ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1723, tv_nsec: 532671838 } })
85252024-11-19T02:23:45.751ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
85262024-11-19T02:23:45.751ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85272024-11-19T02:23:45.751ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85282024-11-19T02:23:45.751ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
85292024-11-19T02:23:45.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85302024-11-19T02:23:45.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85312024-11-19T02:23:45.753ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
85322024-11-19T02:23:45.755ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
85332024-11-19T02:23:45.755ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
85342024-11-19T02:23:45.755ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
85352024-11-19T02:23:45.755ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
85362024-11-19T02:23:45.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
85372024-11-19T02:23:45.755ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85382024-11-19T02:23:45.756ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85392024-11-19T02:23:45.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85402024-11-19T02:23:45.758ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
85412024-11-19T02:23:45.758ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85422024-11-19T02:23:45.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85432024-11-19T02:23:45.767ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85442024-11-19T02:23:45.767ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85452024-11-19T02:23:45.771ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
85462024-11-19T02:23:45.771ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85472024-11-19T02:23:45.771ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
85482024-11-19T02:23:45.771ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
85492024-11-19T02:23:45.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
85502024-11-19T02:23:45.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85512024-11-19T02:23:45.779ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
85522024-11-19T02:23:45.779ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 8c04fa4d-031f-4603-9b0e-246b45d39276 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
85532024-11-19T02:23:45.779ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
85542024-11-19T02:23:45.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
85552024-11-19T02:23:45.781ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85562024-11-19T02:23:45.782ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
85572024-11-19T02:23:45.782ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
85582024-11-19T02:23:45.782ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
85592024-11-19T02:23:45.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
85602024-11-19T02:23:45.783ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
85612024-11-19T02:23:45.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
85622024-11-19T02:23:45.786ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
85632024-11-19T02:23:45.786ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
85642024-11-19T02:23:45.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
85652024-11-19T02:23:45.787ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
85662024-11-19T02:23:45.787ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 59.192388ms iteration = 85 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
85672024-11-19T02:23:45.789ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
85682024-11-19T02:23:45.789ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
85692024-11-19T02:23:45.789ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
85702024-11-19T02:23:45.789ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
85712024-11-19T02:23:45.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
85722024-11-19T02:23:45.789ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
85732024-11-19T02:23:45.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
85742024-11-19T02:23:45.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
85752024-11-19T02:23:45.790ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 61.760416ms iteration = 29 status = {"errors":[],"records_set_to_done":[]}
85762024-11-19T02:23:45.790ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 8c04fa4d-031f-4603-9b0e-246b45d39276 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
85772024-11-19T02:23:45.790ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
85782024-11-19T02:23:45.790ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-19 02:10:27.714570 UTC dns_group = internal generation = 1
85792024-11-19T02:23:45.790ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 61.938639ms iteration = 16 status = {"generation":1}
85802024-11-19T02:23:45.790ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85812024-11-19T02:23:45.790ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85822024-11-19T02:23:45.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85832024-11-19T02:23:45.792ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
85842024-11-19T02:23:45.792ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
85852024-11-19T02:23:45.792ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 63.507727ms iteration = 29 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
85862024-11-19T02:23:45.792ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.7973ms iteration = 85 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
85872024-11-19T02:23:45.792ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85882024-11-19T02:23:45.793ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
85892024-11-19T02:23:45.794ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
85902024-11-19T02:23:45.794ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
85912024-11-19T02:23:45.794ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
85922024-11-19T02:23:45.794ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
85932024-11-19T02:23:45.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
85942024-11-19T02:23:45.795ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
85952024-11-19T02:23:45.795ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
85962024-11-19T02:23:45.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
85972024-11-19T02:23:45.796ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85982024-11-19T02:23:45.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85992024-11-19T02:23:45.796ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86002024-11-19T02:23:45.796ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86012024-11-19T02:23:45.798ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
86022024-11-19T02:23:45.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
86032024-11-19T02:23:45.798ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
86042024-11-19T02:23:45.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
86052024-11-19T02:23:45.799ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
86062024-11-19T02:23:45.799ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86072024-11-19T02:23:45.799ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
86082024-11-19T02:23:45.799ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
86092024-11-19T02:23:45.799ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 71.461998ms iteration = 15 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
86102024-11-19T02:23:45.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86112024-11-19T02:23:45.801ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
86122024-11-19T02:23:45.801ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
86132024-11-19T02:23:45.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
86142024-11-19T02:23:45.801ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86152024-11-19T02:23:45.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86162024-11-19T02:23:45.802ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86172024-11-19T02:23:45.803ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 74.849746ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
86182024-11-19T02:23:45.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
86192024-11-19T02:23:45.806ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
86202024-11-19T02:23:45.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
86212024-11-19T02:23:45.808ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86222024-11-19T02:23:45.811ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
86232024-11-19T02:23:45.812ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 83.554487ms iteration = 29 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
86242024-11-19T02:23:45.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: ffe74824-0c08-48e1-a755-fb123e8dc181, lookup_type: ById(ffe74824-0c08-48e1-a755-fb123e8dc181) } result = Ok(())
86252024-11-19T02:23:45.812ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86262024-11-19T02:23:45.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86272024-11-19T02:23:45.814ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 85.57069ms iteration = 29 status = 0
86282024-11-19T02:23:45.817ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
86292024-11-19T02:23:45.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
86302024-11-19T02:23:45.826ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 98.360776ms iteration = 29 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
86312024-11-19T02:23:45.834ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 106.5012ms iteration = 29 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
86322024-11-19T02:23:45.841ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
86332024-11-19T02:23:45.841ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = af79c7eb-bc4d-42f8-9217-8b35affeeebb dns_zone_name = oxide.test found_so_far = 0 version = 2
86342024-11-19T02:23:45.841ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
86352024-11-19T02:23:45.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
86362024-11-19T02:23:45.843ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86372024-11-19T02:23:45.843ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
86382024-11-19T02:23:45.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
86392024-11-19T02:23:45.845ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86402024-11-19T02:23:45.846ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
86412024-11-19T02:23:45.846ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
86422024-11-19T02:23:45.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
86432024-11-19T02:23:45.847ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
86442024-11-19T02:23:45.847ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
86452024-11-19T02:23:45.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
86462024-11-19T02:23:45.848ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = af79c7eb-bc4d-42f8-9217-8b35affeeebb dns_zone_name = oxide.test found_so_far = 1 version = 2
86472024-11-19T02:23:45.848ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
86482024-11-19T02:23:45.848ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-19 02:10:28.769117 UTC dns_group = external generation = 2
86492024-11-19T02:23:45.848ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 120.310277ms iteration = 16 status = {"generation":2}
86502024-11-19T02:23:45.853ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
86512024-11-19T02:23:45.853ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 124.979221ms iteration = 15 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
86522024-11-19T02:23:45.872ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86532024-11-19T02:23:45.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86542024-11-19T02:23:45.875ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
86552024-11-19T02:23:45.883ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 154.687681ms iteration = 33 status = {"physical_disks_added":0}
86562024-11-19T02:23:45.891ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-19T02:09:41.910054Z, time_modified: 2024-11-19T02:09:41.910054Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 78638afa-e975-44a9-b764-0afec18d156f, db_silo: Silo { identity: SiloIdentity { id: 78638afa-e975-44a9-b764-0afec18d156f, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-19T02:10:28.623188Z, time_modified: 2024-11-19T02:10:28.623188Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "fe94815f3f5502a309deafc95cd58d4fe61e984b7bd8ad11309589068beb64f5" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 78638afa-e975-44a9-b764-0afec18d156f, db_silo: Silo { identity: SiloIdentity { id: 78638afa-e975-44a9-b764-0afec18d156f, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-19T02:10:28.623188Z, time_modified: 2024-11-19T02:10:28.623188Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "fe94815f3f5502a309deafc95cd58d4fe61e984b7bd8ad11309589068beb64f5" }] }) }
86572024-11-19T02:23:45.891ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 163.180419ms iteration = 16 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"78638afa-e975-44a9-b764-0afec18d156f","tls_certs":["fe94815f3f5502a309deafc95cd58d4fe61e984b7bd8ad11309589068beb64f5"]}},"default_endpoint":{"silo_id":"78638afa-e975-44a9-b764-0afec18d156f","tls_certs":["fe94815f3f5502a309deafc95cd58d4fe61e984b7bd8ad11309589068beb64f5"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
86582024-11-19T02:23:45.906ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
86592024-11-19T02:23:45.906ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
86602024-11-19T02:23:45.906ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e62c7f6-a317-4fed-aca7-e100ab763eb6", "content-length": "26", "date": "Tue, 19 Nov 2024 02:23:45 GMT"} })
86612024-11-19T02:23:45.906ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
86622024-11-19T02:23:45.907ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
86632024-11-19T02:23:45.987ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86642024-11-19T02:23:45.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86652024-11-19T02:23:46.105ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
86662024-11-19T02:23:46.105ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
86672024-11-19T02:23:46.106ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea1de5a2-206c-4b4d-a95d-238192d681ea", "content-length": "26", "date": "Tue, 19 Nov 2024 02:23:45 GMT"} })
86682024-11-19T02:23:46.106ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
86692024-11-19T02:23:46.108ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
86702024-11-19T02:23:46.121ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
86712024-11-19T02:23:46.207ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 zone_address = fd00:1122:3344:101::2
86722024-11-19T02:23:46.207ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
86732024-11-19T02:23:46.207ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e3750134-a27b-4457-a161-13ed656b6288", "content-length": "26", "date": "Tue, 19 Nov 2024 02:23:45 GMT"} })
86742024-11-19T02:23:46.207ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
86752024-11-19T02:23:46.209ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
86762024-11-19T02:23:46.257ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
86772024-11-19T02:23:46.267ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
86782024-11-19T02:23:46.267ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "deac9bff-f611-4790-9035-a405dae18018", "content-length": "2", "date": "Tue, 19 Nov 2024 02:23:45 GMT"} })
86792024-11-19T02:23:46.270ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
86802024-11-19T02:23:46.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
86812024-11-19T02:23:46.301ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 573.15462ms iteration = 29 status = {}
86822024-11-19T02:23:46.303ZINFOnexus (BackgroundTasks): VPC route manager sled ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
86832024-11-19T02:23:46.303ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
86842024-11-19T02:23:46.303ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "770ca7a9-e3fa-4218-9b9b-f667a8ae9ffc", "content-length": "372", "date": "Tue, 19 Nov 2024 02:23:46 GMT"} })
86852024-11-19T02:23:46.303ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86862024-11-19T02:23:46.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86872024-11-19T02:23:46.305ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86882024-11-19T02:23:46.305ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 577.100505ms iteration = 29 status = null
86892024-11-19T02:23:46.308ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
86902024-11-19T02:23:46.308ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86912024-11-19T02:23:46.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86922024-11-19T02:23:46.310ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86932024-11-19T02:23:46.312ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
86942024-11-19T02:23:46.312ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86952024-11-19T02:23:46.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86962024-11-19T02:23:46.324ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
86972024-11-19T02:23:46.324ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
86982024-11-19T02:23:46.324ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "1cb3f3db-0907-4c87-98f3-b7d77c76c995", "date": "Tue, 19 Nov 2024 02:23:46 GMT"} })
86992024-11-19T02:23:46.324ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87002024-11-19T02:23:46.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87012024-11-19T02:23:46.326ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87022024-11-19T02:23:46.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87032024-11-19T02:23:46.329ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87042024-11-19T02:23:46.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87052024-11-19T02:23:46.333ZINFOnexus (BackgroundTasks): VPC route manager sled ffe74824-0c08-48e1-a755-fb123e8dc181 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
87062024-11-19T02:23:46.333ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
87072024-11-19T02:23:46.333ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "42c1d927-aaea-4ece-962a-02fa8d486a51", "date": "Tue, 19 Nov 2024 02:23:46 GMT"} })
87082024-11-19T02:23:46.335ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 606.735205ms iteration = 31 status = {}
87092024-11-19T02:23:46.389ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
87102024-11-19T02:23:46.390ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "29779ac8-2bb7-4408-b0ef-fdbadb97065f", "date": "Tue, 19 Nov 2024 02:23:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
87112024-11-19T02:23:46.390ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
87122024-11-19T02:23:46.392ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "c752deff-e238-4646-bb4b-8bcbbaaec2db", "date": "Tue, 19 Nov 2024 02:23:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
87132024-11-19T02:23:46.392ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
87142024-11-19T02:23:46.394ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "98bb0bd3-b12c-46f4-9814-5fe1e3323157", "date": "Tue, 19 Nov 2024 02:23:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
87152024-11-19T02:23:46.394ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
87162024-11-19T02:23:46.396ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
87172024-11-19T02:23:46.396ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 668.3187ms iteration = 17 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
87182024-11-19T02:23:46.398ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
87192024-11-19T02:23:46.398ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "0a715ffd-ed85-46f4-8b63-fe8b8886d1d7", "date": "Tue, 19 Nov 2024 02:23:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
87202024-11-19T02:23:46.398ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
87212024-11-19T02:23:46.400ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "bf138d89-8fd6-408d-bce1-fdf50c1de90f", "date": "Tue, 19 Nov 2024 02:23:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
87222024-11-19T02:23:46.400ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
87232024-11-19T02:23:46.402ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
87242024-11-19T02:23:46.402ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 673.730851ms iteration = 17 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
87252024-11-19T02:23:46.451ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
87262024-11-19T02:23:46.451ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "92a50ef6-f182-4736-910f-a304c90eb214", "content-length": "691", "date": "Tue, 19 Nov 2024 02:23:46 GMT"} })
87272024-11-19T02:23:46.451ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
87282024-11-19T02:23:46.451ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
87292024-11-19T02:23:46.451ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
87302024-11-19T02:23:46.454ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 725.657095ms iteration = 30 status = {}
87312024-11-19T02:23:46.496ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87322024-11-19T02:23:46.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87332024-11-19T02:23:46.499ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 20bc3881-e2ee-4d8d-b84b-b0c1e478721f, rack_id: a894e92e-d765-4f15-b6b7-cb9ca46d1860, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8597d802-6d4d-4493-88de-333a1f340c20) } rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0
87342024-11-19T02:23:46.499ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87352024-11-19T02:23:46.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87362024-11-19T02:23:46.510ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
87372024-11-19T02:23:46.510ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "3be50f59-e39d-4efc-85bc-ef0a8c600534", "content-length": "134", "date": "Tue, 19 Nov 2024 02:23:45 GMT"} })
87382024-11-19T02:23:46.510ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
87392024-11-19T02:23:46.510ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8597d802-6d4d-4493-88de-333a1f340c20
87402024-11-19T02:23:46.510ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
87412024-11-19T02:23:46.510ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
87422024-11-19T02:23:46.510ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
87432024-11-19T02:23:46.510ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
87442024-11-19T02:23:46.510ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
87452024-11-19T02:23:46.510ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
87462024-11-19T02:23:46.511ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
87472024-11-19T02:23:46.511ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
87482024-11-19T02:23:46.511ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
87492024-11-19T02:23:46.511ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87502024-11-19T02:23:46.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87512024-11-19T02:23:46.513ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
87522024-11-19T02:23:46.513ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "a7c87361-8905-47bb-86ee-941804f30e1d", "content-length": "2", "date": "Tue, 19 Nov 2024 02:23:45 GMT"} })
87532024-11-19T02:23:46.513ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
87542024-11-19T02:23:46.513ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "5675b40d-b83e-41ff-8969-5e4b8af67947", "content-length": "52", "date": "Tue, 19 Nov 2024 02:23:45 GMT"} })
87552024-11-19T02:23:46.513ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0
87562024-11-19T02:23:46.513ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
87572024-11-19T02:23:46.640ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "60963b12-3609-4cd5-9213-f44fc7bd8ce4", "date": "Tue, 19 Nov 2024 02:23:46 GMT"} })
87582024-11-19T02:23:46.640ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch = Switch0
87592024-11-19T02:23:46.640ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
87602024-11-19T02:23:46.641ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c9ee567-0c36-4c9e-bd59-74f6cac1c781", "content-length": "682", "date": "Tue, 19 Nov 2024 02:23:46 GMT"} })
87612024-11-19T02:23:46.641ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87622024-11-19T02:23:46.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87632024-11-19T02:23:46.645ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87642024-11-19T02:23:46.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87652024-11-19T02:23:46.649ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87662024-11-19T02:23:46.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87672024-11-19T02:23:46.651ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87682024-11-19T02:23:46.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87692024-11-19T02:23:46.658ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 930.228108ms iteration = 29 status = {}
87702024-11-19T02:23:46.712ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6dc7da86-812e-462b-b48a-55efb3f20b61 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
87712024-11-19T02:23:46.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6dc7da86-812e-462b-b48a-55efb3f20b61 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
87722024-11-19T02:23:46.714ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2590 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6dc7da86-812e-462b-b48a-55efb3f20b61 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
87732024-11-19T02:23:47.741ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6a962b85-d3af-4ef9-b49d-384904ef19cc roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
87742024-11-19T02:23:47.741ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6a962b85-d3af-4ef9-b49d-384904ef19cc resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
87752024-11-19T02:23:47.743ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2514 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6a962b85-d3af-4ef9-b49d-384904ef19cc response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
87762024-11-19T02:23:48.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 7d07a64a-a85f-44e3-a313-7a7a9414c469 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
87772024-11-19T02:23:48.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 7d07a64a-a85f-44e3-a313-7a7a9414c469 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
87782024-11-19T02:23:48.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2534 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 7d07a64a-a85f-44e3-a313-7a7a9414c469 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
87792024-11-19T02:23:49.791ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 51e1ff6b-2bdf-4f1b-9590-920f43da9903 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
87802024-11-19T02:23:49.792ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 51e1ff6b-2bdf-4f1b-9590-920f43da9903 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
87812024-11-19T02:23:49.793ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2168 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 51e1ff6b-2bdf-4f1b-9590-920f43da9903 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
87822024-11-19T02:23:50.816ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = f19da181-6dfa-4e99-9143-d2f4d2b694aa roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
87832024-11-19T02:23:50.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = f19da181-6dfa-4e99-9143-d2f4d2b694aa resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
87842024-11-19T02:23:50.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2512 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = f19da181-6dfa-4e99-9143-d2f4d2b694aa response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
87852024-11-19T02:23:51.840ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6f5e0efb-9268-449f-b07b-1faef9bb28ee roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
87862024-11-19T02:23:51.841ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6f5e0efb-9268-449f-b07b-1faef9bb28ee resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
87872024-11-19T02:23:51.843ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3117 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 6f5e0efb-9268-449f-b07b-1faef9bb28ee response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
87882024-11-19T02:23:52.157ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1344 local_addr = [fd00:1122:3344:101::c]:60807 method = GET remote_addr = [fd00:1122:3344:101::d]:57844 req_id = bfcc3d6b-ad9f-4502-baaf-970a70abf056 response_code = 200 uri = /9f0b435f-0000-451e-9dbc-dcec71543c30
87892024-11-19T02:23:52.865ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 565292b3-0f4e-40df-af58-84bed7a6781b roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
87902024-11-19T02:23:52.865ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 565292b3-0f4e-40df-af58-84bed7a6781b resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
87912024-11-19T02:23:52.867ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3030 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 565292b3-0f4e-40df-af58-84bed7a6781b response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
87922024-11-19T02:23:53.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b3667cc1-7a37-4cf8-8ab3-886ae20d9bd1 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
87932024-11-19T02:23:53.892ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b3667cc1-7a37-4cf8-8ab3-886ae20d9bd1 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
87942024-11-19T02:23:53.894ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2531 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b3667cc1-7a37-4cf8-8ab3-886ae20d9bd1 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
87952024-11-19T02:23:54.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0c1208d1-dfa3-4874-bd6b-f33f846d27e3 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
87962024-11-19T02:23:54.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0c1208d1-dfa3-4874-bd6b-f33f846d27e3 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
87972024-11-19T02:23:54.919ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2496 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0c1208d1-dfa3-4874-bd6b-f33f846d27e3 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
87982024-11-19T02:23:55.728ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 86 reason = Timeout
87992024-11-19T02:23:55.728ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 86 reason = Timeout
88002024-11-19T02:23:55.728ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88012024-11-19T02:23:55.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88022024-11-19T02:23:55.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88032024-11-19T02:23:55.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88042024-11-19T02:23:55.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88052024-11-19T02:23:55.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
88062024-11-19T02:23:55.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88072024-11-19T02:23:55.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88082024-11-19T02:23:55.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88092024-11-19T02:23:55.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88102024-11-19T02:23:55.738ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88112024-11-19T02:23:55.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
88122024-11-19T02:23:55.740ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88132024-11-19T02:23:55.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88142024-11-19T02:23:55.751ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
88152024-11-19T02:23:55.751ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.854242ms iteration = 86 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
88162024-11-19T02:23:55.757ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88172024-11-19T02:23:55.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88182024-11-19T02:23:55.786ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.718871ms iteration = 86 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
88192024-11-19T02:23:55.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 7c671f32-70a5-4a3c-8e9c-c2ea2354c70d roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
88202024-11-19T02:23:55.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 7c671f32-70a5-4a3c-8e9c-c2ea2354c70d resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
88212024-11-19T02:23:55.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1717 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 7c671f32-70a5-4a3c-8e9c-c2ea2354c70d response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
88222024-11-19T02:23:56.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 7259ba7c-1b05-4c05-80f0-ef0f3cd3f212 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
88232024-11-19T02:23:56.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 7259ba7c-1b05-4c05-80f0-ef0f3cd3f212 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
88242024-11-19T02:23:56.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2211 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 7259ba7c-1b05-4c05-80f0-ef0f3cd3f212 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
88252024-11-19T02:23:57.991ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 353d23e0-aec8-448f-a350-6ca1af103dbd roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
88262024-11-19T02:23:57.992ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 353d23e0-aec8-448f-a350-6ca1af103dbd resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
88272024-11-19T02:23:57.993ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2341 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 353d23e0-aec8-448f-a350-6ca1af103dbd response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
88282024-11-19T02:23:59.016ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = eee2ba06-0e64-4542-9595-8a3a537a3198 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
88292024-11-19T02:23:59.017ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = eee2ba06-0e64-4542-9595-8a3a537a3198 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
88302024-11-19T02:23:59.019ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2428 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = eee2ba06-0e64-4542-9595-8a3a537a3198 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
88312024-11-19T02:24:00.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 39499506-4b85-40ba-a33e-0feea25ae398 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
88322024-11-19T02:24:00.041ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 39499506-4b85-40ba-a33e-0feea25ae398 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
88332024-11-19T02:24:00.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1922 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 39499506-4b85-40ba-a33e-0feea25ae398 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
88342024-11-19T02:24:01.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 13396a4f-a5e7-42c0-9cf4-f0bd13a266ce roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
88352024-11-19T02:24:01.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 13396a4f-a5e7-42c0-9cf4-f0bd13a266ce resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
88362024-11-19T02:24:01.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2424 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 13396a4f-a5e7-42c0-9cf4-f0bd13a266ce response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
88372024-11-19T02:24:02.090ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3459ff3c-c1b4-4ec6-96bf-90e8ef3f9c48 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
88382024-11-19T02:24:02.090ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3459ff3c-c1b4-4ec6-96bf-90e8ef3f9c48 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
88392024-11-19T02:24:02.092ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2393 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3459ff3c-c1b4-4ec6-96bf-90e8ef3f9c48 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
88402024-11-19T02:24:03.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9752ec7e-8e0d-4a3f-9558-9db103c76174 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
88412024-11-19T02:24:03.118ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9752ec7e-8e0d-4a3f-9558-9db103c76174 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
88422024-11-19T02:24:03.119ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2536 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9752ec7e-8e0d-4a3f-9558-9db103c76174 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
88432024-11-19T02:24:04.142ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 2daff936-7cac-406a-a291-519c4d2cd26d roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
88442024-11-19T02:24:04.142ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 2daff936-7cac-406a-a291-519c4d2cd26d resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
88452024-11-19T02:24:04.144ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2115 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 2daff936-7cac-406a-a291-519c4d2cd26d response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
88462024-11-19T02:24:05.167ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0fafb327-2f82-438a-a3cf-d3afea9f27c5 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
88472024-11-19T02:24:05.167ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0fafb327-2f82-438a-a3cf-d3afea9f27c5 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
88482024-11-19T02:24:05.169ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1969 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0fafb327-2f82-438a-a3cf-d3afea9f27c5 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
88492024-11-19T02:24:05.728ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 87 reason = Timeout
88502024-11-19T02:24:05.728ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 87 reason = Timeout
88512024-11-19T02:24:05.728ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88522024-11-19T02:24:05.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88532024-11-19T02:24:05.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88542024-11-19T02:24:05.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88552024-11-19T02:24:05.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88562024-11-19T02:24:05.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
88572024-11-19T02:24:05.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88582024-11-19T02:24:05.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88592024-11-19T02:24:05.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88602024-11-19T02:24:05.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88612024-11-19T02:24:05.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88622024-11-19T02:24:05.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
88632024-11-19T02:24:05.740ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88642024-11-19T02:24:05.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88652024-11-19T02:24:05.750ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
88662024-11-19T02:24:05.750ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.674328ms iteration = 87 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
88672024-11-19T02:24:05.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88682024-11-19T02:24:05.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88692024-11-19T02:24:05.760ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.599892ms iteration = 87 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
88702024-11-19T02:24:06.192ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 5d56f136-83fd-45e5-91e4-7c6bdafb9e55 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
88712024-11-19T02:24:06.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 5d56f136-83fd-45e5-91e4-7c6bdafb9e55 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
88722024-11-19T02:24:06.195ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2447 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 5d56f136-83fd-45e5-91e4-7c6bdafb9e55 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
88732024-11-19T02:24:07.157ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1824 local_addr = [fd00:1122:3344:101::c]:60807 method = GET remote_addr = [fd00:1122:3344:101::d]:57844 req_id = 67d26e80-fa24-4d49-9cf4-7977a02013c9 response_code = 200 uri = /9f0b435f-0000-451e-9dbc-dcec71543c30
88742024-11-19T02:24:07.218ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 04a1fcd1-cc69-4a39-a60f-4d96544daa85 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
88752024-11-19T02:24:07.218ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 04a1fcd1-cc69-4a39-a60f-4d96544daa85 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
88762024-11-19T02:24:07.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2145 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 04a1fcd1-cc69-4a39-a60f-4d96544daa85 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
88772024-11-19T02:24:08.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c744194d-4b26-42a1-aea3-6fa0abc984eb roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
88782024-11-19T02:24:08.247ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c744194d-4b26-42a1-aea3-6fa0abc984eb resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
88792024-11-19T02:24:08.249ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2446 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c744194d-4b26-42a1-aea3-6fa0abc984eb response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
88802024-11-19T02:24:09.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a4b253b3-4b17-4b14-9fce-cda838ad6db2 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
88812024-11-19T02:24:09.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a4b253b3-4b17-4b14-9fce-cda838ad6db2 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
88822024-11-19T02:24:09.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2127 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a4b253b3-4b17-4b14-9fce-cda838ad6db2 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
88832024-11-19T02:24:10.296ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 76158d04-cd68-4c1c-8cf0-ef1044237ca4 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
88842024-11-19T02:24:10.297ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 76158d04-cd68-4c1c-8cf0-ef1044237ca4 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
88852024-11-19T02:24:10.299ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2738 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 76158d04-cd68-4c1c-8cf0-ef1044237ca4 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
88862024-11-19T02:24:11.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3b24cede-9562-48fc-924d-12e11153c04d roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
88872024-11-19T02:24:11.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3b24cede-9562-48fc-924d-12e11153c04d resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
88882024-11-19T02:24:11.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2603 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3b24cede-9562-48fc-924d-12e11153c04d response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
88892024-11-19T02:24:12.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 5bcaae01-f55c-450e-9ce8-16e58e39c7ec roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
88902024-11-19T02:24:12.346ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 5bcaae01-f55c-450e-9ce8-16e58e39c7ec resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
88912024-11-19T02:24:12.348ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2846 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 5bcaae01-f55c-450e-9ce8-16e58e39c7ec response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
88922024-11-19T02:24:13.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = f7b6f23d-10c0-430b-89b3-d264b7de7653 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
88932024-11-19T02:24:13.373ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = f7b6f23d-10c0-430b-89b3-d264b7de7653 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
88942024-11-19T02:24:13.375ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2718 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = f7b6f23d-10c0-430b-89b3-d264b7de7653 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
88952024-11-19T02:24:14.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = f63d00ba-d724-499b-bbe7-38ee0295e723 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
88962024-11-19T02:24:14.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = f63d00ba-d724-499b-bbe7-38ee0295e723 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
88972024-11-19T02:24:14.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1759 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = f63d00ba-d724-499b-bbe7-38ee0295e723 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
88982024-11-19T02:24:15.404ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = 28ec6db9-9269-411d-be96-05092e079549 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
88992024-11-19T02:24:15.404ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = 28ec6db9-9269-411d-be96-05092e079549 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
89002024-11-19T02:24:15.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4041 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = 28ec6db9-9269-411d-be96-05092e079549 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
89012024-11-19T02:24:15.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = cbf5a5cb-1fd8-405d-b7ce-1f374a7c0a5e roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
89022024-11-19T02:24:15.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = cbf5a5cb-1fd8-405d-b7ce-1f374a7c0a5e resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
89032024-11-19T02:24:15.426ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2591 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = cbf5a5cb-1fd8-405d-b7ce-1f374a7c0a5e response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
89042024-11-19T02:24:15.728ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 30 reason = Timeout
89052024-11-19T02:24:15.728ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 30 reason = Timeout
89062024-11-19T02:24:15.728ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
89072024-11-19T02:24:15.728ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
89082024-11-19T02:24:15.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
89092024-11-19T02:24:15.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
89102024-11-19T02:24:15.729ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 88 reason = Timeout
89112024-11-19T02:24:15.729ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 30 reason = Timeout
89122024-11-19T02:24:15.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89132024-11-19T02:24:15.729ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 30 reason = Timeout
89142024-11-19T02:24:15.729ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
89152024-11-19T02:24:15.729ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89162024-11-19T02:24:15.729ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
89172024-11-19T02:24:15.729ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 88 reason = Timeout
89182024-11-19T02:24:15.729ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 30 reason = Timeout
89192024-11-19T02:24:15.729ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
89202024-11-19T02:24:15.729ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 30 reason = Timeout
89212024-11-19T02:24:15.729ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
89222024-11-19T02:24:15.729ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
89232024-11-19T02:24:15.729ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 31 reason = Timeout
89242024-11-19T02:24:15.729ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 30 reason = Timeout
89252024-11-19T02:24:15.729ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89262024-11-19T02:24:15.729ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89272024-11-19T02:24:15.729ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 30 reason = Timeout
89282024-11-19T02:24:15.729ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
89292024-11-19T02:24:15.729ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 34 reason = Timeout
89302024-11-19T02:24:15.729ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89312024-11-19T02:24:15.729ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 30 reason = Timeout
89322024-11-19T02:24:15.729ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 30 reason = Timeout
89332024-11-19T02:24:15.729ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
89342024-11-19T02:24:15.729ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
89352024-11-19T02:24:15.729ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 32 reason = Timeout
89362024-11-19T02:24:15.729ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
89372024-11-19T02:24:15.729ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 30 reason = Timeout
89382024-11-19T02:24:15.729ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89392024-11-19T02:24:15.729ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 30 reason = Timeout
89402024-11-19T02:24:15.729ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
89412024-11-19T02:24:15.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
89422024-11-19T02:24:15.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89432024-11-19T02:24:15.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89442024-11-19T02:24:15.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
89452024-11-19T02:24:15.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89462024-11-19T02:24:15.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89472024-11-19T02:24:15.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
89482024-11-19T02:24:15.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89492024-11-19T02:24:15.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89502024-11-19T02:24:15.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
89512024-11-19T02:24:15.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
89522024-11-19T02:24:15.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
89532024-11-19T02:24:15.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89542024-11-19T02:24:15.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
89552024-11-19T02:24:15.731ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1753, tv_nsec: 512191914 } })
89562024-11-19T02:24:15.731ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
89572024-11-19T02:24:15.731ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1753, tv_nsec: 512717090 } })
89582024-11-19T02:24:15.732ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
89592024-11-19T02:24:15.732ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89602024-11-19T02:24:15.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89612024-11-19T02:24:15.733ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
89622024-11-19T02:24:15.733ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
89632024-11-19T02:24:15.733ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
89642024-11-19T02:24:15.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
89652024-11-19T02:24:15.733ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.026306ms iteration = 30 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
89662024-11-19T02:24:15.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
89672024-11-19T02:24:15.735ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89682024-11-19T02:24:15.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89692024-11-19T02:24:15.736ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
89702024-11-19T02:24:15.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89712024-11-19T02:24:15.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89722024-11-19T02:24:15.738ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
89732024-11-19T02:24:15.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89742024-11-19T02:24:15.738ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89752024-11-19T02:24:15.739ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.465098ms iteration = 30 status = {"errors":[],"garbage_collect_requested":[]}
89762024-11-19T02:24:15.739ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89772024-11-19T02:24:15.740ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
89782024-11-19T02:24:15.740ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89792024-11-19T02:24:15.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89802024-11-19T02:24:15.742ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
89812024-11-19T02:24:15.742ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
89822024-11-19T02:24:15.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
89832024-11-19T02:24:15.744ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
89842024-11-19T02:24:15.744ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
89852024-11-19T02:24:15.744ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
89862024-11-19T02:24:15.744ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89872024-11-19T02:24:15.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
89882024-11-19T02:24:15.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89892024-11-19T02:24:15.745ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1753, tv_nsec: 526131283 } })
89902024-11-19T02:24:15.745ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
89912024-11-19T02:24:15.746ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89922024-11-19T02:24:15.749ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
89932024-11-19T02:24:15.749ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89942024-11-19T02:24:15.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89952024-11-19T02:24:15.750ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
89962024-11-19T02:24:15.750ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 21.053961ms iteration = 30 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
89972024-11-19T02:24:15.773ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
89982024-11-19T02:24:15.773ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 44.441308ms iteration = 88 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
89992024-11-19T02:24:15.775ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90002024-11-19T02:24:15.775ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90012024-11-19T02:24:15.776ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 47.18051ms iteration = 30 status = {"errors":[],"records_set_to_done":[]}
90022024-11-19T02:24:15.777ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
90032024-11-19T02:24:15.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
90042024-11-19T02:24:15.778ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
90052024-11-19T02:24:15.778ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
90062024-11-19T02:24:15.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
90072024-11-19T02:24:15.778ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
90082024-11-19T02:24:15.778ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90092024-11-19T02:24:15.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90102024-11-19T02:24:15.781ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
90112024-11-19T02:24:15.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
90122024-11-19T02:24:15.781ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90132024-11-19T02:24:15.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90142024-11-19T02:24:15.783ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
90152024-11-19T02:24:15.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
90162024-11-19T02:24:15.784ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
90172024-11-19T02:24:15.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
90182024-11-19T02:24:15.785ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90192024-11-19T02:24:15.786ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.126794ms iteration = 88 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
90202024-11-19T02:24:15.787ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
90212024-11-19T02:24:15.787ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90222024-11-19T02:24:15.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90232024-11-19T02:24:15.788ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
90242024-11-19T02:24:15.788ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
90252024-11-19T02:24:15.788ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 59.135587ms iteration = 30 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
90262024-11-19T02:24:15.803ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90272024-11-19T02:24:15.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90282024-11-19T02:24:15.805ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
90292024-11-19T02:24:15.805ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
90302024-11-19T02:24:15.805ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "50bc6431-5786-487a-ba9a-3bd60d3837b4", "content-length": "26", "date": "Tue, 19 Nov 2024 02:24:15 GMT"} })
90312024-11-19T02:24:15.805ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
90322024-11-19T02:24:15.805ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90332024-11-19T02:24:15.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90342024-11-19T02:24:15.806ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
90352024-11-19T02:24:15.806ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 77.419407ms iteration = 30 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
90362024-11-19T02:24:15.807ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90372024-11-19T02:24:15.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: ffe74824-0c08-48e1-a755-fb123e8dc181, lookup_type: ById(ffe74824-0c08-48e1-a755-fb123e8dc181) } result = Ok(())
90382024-11-19T02:24:15.809ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90392024-11-19T02:24:15.809ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
90402024-11-19T02:24:15.809ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
90412024-11-19T02:24:15.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90422024-11-19T02:24:15.810ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf5d5e0a-6728-422b-8483-b2761c60234c", "content-length": "26", "date": "Tue, 19 Nov 2024 02:24:15 GMT"} })
90432024-11-19T02:24:15.810ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
90442024-11-19T02:24:15.811ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 82.065249ms iteration = 30 status = 0
90452024-11-19T02:24:15.811ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
90462024-11-19T02:24:15.812ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90472024-11-19T02:24:15.813ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 84.293744ms iteration = 30 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
90482024-11-19T02:24:15.814ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
90492024-11-19T02:24:15.814ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
90502024-11-19T02:24:15.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
90512024-11-19T02:24:15.815ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
90522024-11-19T02:24:15.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
90532024-11-19T02:24:15.845ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
90542024-11-19T02:24:15.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
90552024-11-19T02:24:15.861ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 zone_address = fd00:1122:3344:101::2
90562024-11-19T02:24:15.861ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
90572024-11-19T02:24:15.862ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d00b607-cc2f-4fd9-8439-0542bef1bb36", "content-length": "26", "date": "Tue, 19 Nov 2024 02:24:15 GMT"} })
90582024-11-19T02:24:15.862ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
90592024-11-19T02:24:15.864ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
90602024-11-19T02:24:15.906ZINFOnexus (BackgroundTasks): VPC route manager sled ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
90612024-11-19T02:24:15.906ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
90622024-11-19T02:24:15.907ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1b5399d2-1a09-407e-9552-4f0665069824", "content-length": "372", "date": "Tue, 19 Nov 2024 02:24:15 GMT"} })
90632024-11-19T02:24:15.907ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90642024-11-19T02:24:15.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90652024-11-19T02:24:15.920ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 192.23261ms iteration = 30 status = {}
90662024-11-19T02:24:15.924ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
90672024-11-19T02:24:15.924ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "addb7d1c-0ff8-421e-a90e-8b45919bea54", "content-length": "2", "date": "Tue, 19 Nov 2024 02:24:15 GMT"} })
90682024-11-19T02:24:15.927ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
90692024-11-19T02:24:15.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
90702024-11-19T02:24:15.929ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 201.189423ms iteration = 30 status = null
90712024-11-19T02:24:15.949ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 219.450692ms iteration = 30 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
90722024-11-19T02:24:15.956ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 227.335002ms iteration = 34 status = {"physical_disks_added":0}
90732024-11-19T02:24:15.972ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
90742024-11-19T02:24:15.972ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
90752024-11-19T02:24:15.973ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "1a636f77-a3c8-4db2-abfb-8c9385e66f94", "date": "Tue, 19 Nov 2024 02:24:15 GMT"} })
90762024-11-19T02:24:15.973ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90772024-11-19T02:24:15.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90782024-11-19T02:24:15.975ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90792024-11-19T02:24:15.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90802024-11-19T02:24:15.979ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90812024-11-19T02:24:15.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90822024-11-19T02:24:15.983ZINFOnexus (BackgroundTasks): VPC route manager sled ffe74824-0c08-48e1-a755-fb123e8dc181 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
90832024-11-19T02:24:15.983ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
90842024-11-19T02:24:15.983ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "7f81f961-cb64-47d6-aaa1-01fc0b372cd4", "date": "Tue, 19 Nov 2024 02:24:15 GMT"} })
90852024-11-19T02:24:15.985ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 255.404774ms iteration = 32 status = {}
90862024-11-19T02:24:16.009ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90872024-11-19T02:24:16.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90882024-11-19T02:24:16.011ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 20bc3881-e2ee-4d8d-b84b-b0c1e478721f, rack_id: a894e92e-d765-4f15-b6b7-cb9ca46d1860, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8597d802-6d4d-4493-88de-333a1f340c20) } rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0
90892024-11-19T02:24:16.011ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90902024-11-19T02:24:16.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90912024-11-19T02:24:16.024ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
90922024-11-19T02:24:16.024ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "fd04c913-731f-47c8-8bd0-336ba4a998da", "content-length": "134", "date": "Tue, 19 Nov 2024 02:24:15 GMT"} })
90932024-11-19T02:24:16.024ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
90942024-11-19T02:24:16.024ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8597d802-6d4d-4493-88de-333a1f340c20
90952024-11-19T02:24:16.024ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
90962024-11-19T02:24:16.024ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
90972024-11-19T02:24:16.024ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90982024-11-19T02:24:16.024ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90992024-11-19T02:24:16.024ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
91002024-11-19T02:24:16.024ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
91012024-11-19T02:24:16.025ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
91022024-11-19T02:24:16.025ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
91032024-11-19T02:24:16.025ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
91042024-11-19T02:24:16.025ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91052024-11-19T02:24:16.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91062024-11-19T02:24:16.027ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
91072024-11-19T02:24:16.027ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c626905-8cdc-4763-ad70-8c8a81b55b60", "content-length": "2", "date": "Tue, 19 Nov 2024 02:24:15 GMT"} })
91082024-11-19T02:24:16.027ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
91092024-11-19T02:24:16.027ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "cb2834dc-633b-4e2d-b8bb-f81d27d6fa87", "content-length": "52", "date": "Tue, 19 Nov 2024 02:24:15 GMT"} })
91102024-11-19T02:24:16.027ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0
91112024-11-19T02:24:16.027ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
91122024-11-19T02:24:16.031ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91132024-11-19T02:24:16.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
91142024-11-19T02:24:16.061ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91152024-11-19T02:24:16.064ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
91162024-11-19T02:24:16.064ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91172024-11-19T02:24:16.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
91182024-11-19T02:24:16.067ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91192024-11-19T02:24:16.070ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
91202024-11-19T02:24:16.070ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91212024-11-19T02:24:16.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
91222024-11-19T02:24:16.121ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
91232024-11-19T02:24:16.178ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "795f9851-adbf-4939-8538-596d534892c3", "date": "Tue, 19 Nov 2024 02:24:15 GMT"} })
91242024-11-19T02:24:16.178ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch = Switch0
91252024-11-19T02:24:16.178ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
91262024-11-19T02:24:16.178ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "343d166f-cc99-4c36-becb-9bbe0b99ca06", "content-length": "682", "date": "Tue, 19 Nov 2024 02:24:16 GMT"} })
91272024-11-19T02:24:16.179ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91282024-11-19T02:24:16.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91292024-11-19T02:24:16.179ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "715c8a68-3f95-47dc-b5bb-290dd8162a0b", "content-length": "691", "date": "Tue, 19 Nov 2024 02:24:15 GMT"} })
91302024-11-19T02:24:16.179ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
91312024-11-19T02:24:16.179ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
91322024-11-19T02:24:16.179ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
91332024-11-19T02:24:16.181ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 451.595509ms iteration = 31 status = {}
91342024-11-19T02:24:16.182ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91352024-11-19T02:24:16.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91362024-11-19T02:24:16.186ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91372024-11-19T02:24:16.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91382024-11-19T02:24:16.189ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91392024-11-19T02:24:16.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91402024-11-19T02:24:16.196ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 467.359819ms iteration = 30 status = {}
91412024-11-19T02:24:16.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = fb8a2a64-9321-400b-9652-4e0440af79d0 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
91422024-11-19T02:24:16.501ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = fb8a2a64-9321-400b-9652-4e0440af79d0 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
91432024-11-19T02:24:16.503ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2530 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = fb8a2a64-9321-400b-9652-4e0440af79d0 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
91442024-11-19T02:24:17.530ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 707b766c-957c-4b87-b6f3-bc05f82db1ed roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
91452024-11-19T02:24:17.531ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 707b766c-957c-4b87-b6f3-bc05f82db1ed resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
91462024-11-19T02:24:17.533ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2561 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 707b766c-957c-4b87-b6f3-bc05f82db1ed response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
91472024-11-19T02:24:18.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 482231ac-7b19-4f7a-b49c-2c96e54cc4dd roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
91482024-11-19T02:24:18.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 482231ac-7b19-4f7a-b49c-2c96e54cc4dd resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
91492024-11-19T02:24:18.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2459 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 482231ac-7b19-4f7a-b49c-2c96e54cc4dd response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
91502024-11-19T02:24:19.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = aada292d-f584-4a08-9064-818685225561 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
91512024-11-19T02:24:19.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = aada292d-f584-4a08-9064-818685225561 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
91522024-11-19T02:24:19.584ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2526 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = aada292d-f584-4a08-9064-818685225561 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
91532024-11-19T02:24:20.606ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e004f72d-baf7-432f-9c04-ce04eac02b89 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
91542024-11-19T02:24:20.606ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e004f72d-baf7-432f-9c04-ce04eac02b89 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
91552024-11-19T02:24:20.608ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2210 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e004f72d-baf7-432f-9c04-ce04eac02b89 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
91562024-11-19T02:24:21.631ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c1e00508-622d-4668-8537-df8a6861e316 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
91572024-11-19T02:24:21.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c1e00508-622d-4668-8537-df8a6861e316 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
91582024-11-19T02:24:21.633ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2618 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c1e00508-622d-4668-8537-df8a6861e316 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
91592024-11-19T02:24:22.158ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1376 local_addr = [fd00:1122:3344:101::c]:60807 method = GET remote_addr = [fd00:1122:3344:101::d]:57844 req_id = 87e79fa0-c1fe-4e00-a7ba-c81c10819a8a response_code = 200 uri = /9f0b435f-0000-451e-9dbc-dcec71543c30
91602024-11-19T02:24:22.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 84f123e2-c677-45e8-a07f-3764795cdb05 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
91612024-11-19T02:24:22.656ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 84f123e2-c677-45e8-a07f-3764795cdb05 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
91622024-11-19T02:24:22.658ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2928 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 84f123e2-c677-45e8-a07f-3764795cdb05 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
91632024-11-19T02:24:23.683ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ef5e2da5-5dcb-4ec0-97e6-58c0aea2333f roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
91642024-11-19T02:24:23.683ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ef5e2da5-5dcb-4ec0-97e6-58c0aea2333f resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
91652024-11-19T02:24:23.684ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1977 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ef5e2da5-5dcb-4ec0-97e6-58c0aea2333f response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
91662024-11-19T02:24:24.707ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4fe76f2f-d5f4-4663-b618-e98e808374fd roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
91672024-11-19T02:24:24.708ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4fe76f2f-d5f4-4663-b618-e98e808374fd resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
91682024-11-19T02:24:24.710ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2652 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4fe76f2f-d5f4-4663-b618-e98e808374fd response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
91692024-11-19T02:24:25.729ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 89 reason = Timeout
91702024-11-19T02:24:25.729ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 89 reason = Timeout
91712024-11-19T02:24:25.729ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91722024-11-19T02:24:25.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91732024-11-19T02:24:25.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91742024-11-19T02:24:25.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91752024-11-19T02:24:25.731ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91762024-11-19T02:24:25.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a50bdbdc-0b70-4838-9e39-f574397df372 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
91772024-11-19T02:24:25.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91782024-11-19T02:24:25.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a50bdbdc-0b70-4838-9e39-f574397df372 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
91792024-11-19T02:24:25.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91802024-11-19T02:24:25.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2044 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a50bdbdc-0b70-4838-9e39-f574397df372 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
91812024-11-19T02:24:25.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
91822024-11-19T02:24:25.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91832024-11-19T02:24:25.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91842024-11-19T02:24:25.741ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91852024-11-19T02:24:25.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91862024-11-19T02:24:25.743ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91872024-11-19T02:24:25.745ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
91882024-11-19T02:24:25.745ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91892024-11-19T02:24:25.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91902024-11-19T02:24:25.757ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
91912024-11-19T02:24:25.757ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 28.066301ms iteration = 89 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
91922024-11-19T02:24:25.758ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.293495ms iteration = 89 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
91932024-11-19T02:24:26.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c965313f-cfae-4b3e-bf12-9edacdaefd4f roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
91942024-11-19T02:24:26.756ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c965313f-cfae-4b3e-bf12-9edacdaefd4f resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
91952024-11-19T02:24:26.758ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2648 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = c965313f-cfae-4b3e-bf12-9edacdaefd4f response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
91962024-11-19T02:24:27.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = aeb66b1b-ff0b-4006-b586-49a778518d28 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
91972024-11-19T02:24:27.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = aeb66b1b-ff0b-4006-b586-49a778518d28 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
91982024-11-19T02:24:27.783ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2169 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = aeb66b1b-ff0b-4006-b586-49a778518d28 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
91992024-11-19T02:24:28.806ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 329acc43-eb3e-4ca1-a107-3a6c4007c2d8 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
92002024-11-19T02:24:28.807ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 329acc43-eb3e-4ca1-a107-3a6c4007c2d8 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
92012024-11-19T02:24:28.809ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2308 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 329acc43-eb3e-4ca1-a107-3a6c4007c2d8 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
92022024-11-19T02:24:29.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d37b50ca-8f4c-464f-9a3d-ceb296c1eb9e roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
92032024-11-19T02:24:29.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d37b50ca-8f4c-464f-9a3d-ceb296c1eb9e resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
92042024-11-19T02:24:29.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2582 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d37b50ca-8f4c-464f-9a3d-ceb296c1eb9e response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
92052024-11-19T02:24:30.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = fd56f720-c1d3-4cd6-94fd-1d61815e4fda roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
92062024-11-19T02:24:30.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = fd56f720-c1d3-4cd6-94fd-1d61815e4fda resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
92072024-11-19T02:24:30.858ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2451 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = fd56f720-c1d3-4cd6-94fd-1d61815e4fda response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
92082024-11-19T02:24:31.882ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4444a5f3-9aee-4d7c-b504-fd28f227e338 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
92092024-11-19T02:24:31.883ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4444a5f3-9aee-4d7c-b504-fd28f227e338 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
92102024-11-19T02:24:31.884ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2200 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4444a5f3-9aee-4d7c-b504-fd28f227e338 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
92112024-11-19T02:24:32.908ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e7a62606-1372-47b7-b046-18d06f51e495 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
92122024-11-19T02:24:32.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e7a62606-1372-47b7-b046-18d06f51e495 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
92132024-11-19T02:24:32.910ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2020 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = e7a62606-1372-47b7-b046-18d06f51e495 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
92142024-11-19T02:24:33.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 659540ef-8a19-476e-bf3c-cbe4606bbb4c roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
92152024-11-19T02:24:33.934ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 659540ef-8a19-476e-bf3c-cbe4606bbb4c resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
92162024-11-19T02:24:33.936ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2774 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 659540ef-8a19-476e-bf3c-cbe4606bbb4c response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
92172024-11-19T02:24:34.960ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0d2e5b9a-1625-4e4d-8c9e-d5f234cc177f roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
92182024-11-19T02:24:34.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0d2e5b9a-1625-4e4d-8c9e-d5f234cc177f resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
92192024-11-19T02:24:34.962ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2218 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0d2e5b9a-1625-4e4d-8c9e-d5f234cc177f response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
92202024-11-19T02:24:35.729ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 90 reason = Timeout
92212024-11-19T02:24:35.729ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92222024-11-19T02:24:35.729ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 90 reason = Timeout
92232024-11-19T02:24:35.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92242024-11-19T02:24:35.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92252024-11-19T02:24:35.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92262024-11-19T02:24:35.731ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92272024-11-19T02:24:35.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92282024-11-19T02:24:35.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92292024-11-19T02:24:35.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
92302024-11-19T02:24:35.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92312024-11-19T02:24:35.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92322024-11-19T02:24:35.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92332024-11-19T02:24:35.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92342024-11-19T02:24:35.739ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92352024-11-19T02:24:35.741ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
92362024-11-19T02:24:35.741ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92372024-11-19T02:24:35.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92382024-11-19T02:24:35.751ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
92392024-11-19T02:24:35.751ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.150204ms iteration = 90 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
92402024-11-19T02:24:35.763ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.762687ms iteration = 90 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
92412024-11-19T02:24:35.984ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d6631033-5777-4f51-b904-4eb0f400e910 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
92422024-11-19T02:24:35.984ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d6631033-5777-4f51-b904-4eb0f400e910 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
92432024-11-19T02:24:35.986ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2493 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d6631033-5777-4f51-b904-4eb0f400e910 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
92442024-11-19T02:24:37.009ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = f42624bd-b838-48c0-95eb-0bae7f3eae71 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
92452024-11-19T02:24:37.009ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = f42624bd-b838-48c0-95eb-0bae7f3eae71 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
92462024-11-19T02:24:37.011ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2044 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = f42624bd-b838-48c0-95eb-0bae7f3eae71 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
92472024-11-19T02:24:37.159ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1588 local_addr = [fd00:1122:3344:101::c]:60807 method = GET remote_addr = [fd00:1122:3344:101::d]:57844 req_id = b6e26152-5c9b-48f5-b748-5c4b4a65c989 response_code = 200 uri = /9f0b435f-0000-451e-9dbc-dcec71543c30
92482024-11-19T02:24:38.034ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d20e23bb-80b8-465c-8641-ea841ec8d7c9 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
92492024-11-19T02:24:38.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d20e23bb-80b8-465c-8641-ea841ec8d7c9 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
92502024-11-19T02:24:38.036ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2826 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d20e23bb-80b8-465c-8641-ea841ec8d7c9 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
92512024-11-19T02:24:39.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a1838d8f-466d-4a7d-ac78-887094953d17 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
92522024-11-19T02:24:39.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a1838d8f-466d-4a7d-ac78-887094953d17 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
92532024-11-19T02:24:39.062ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2485 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = a1838d8f-466d-4a7d-ac78-887094953d17 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
92542024-11-19T02:24:40.085ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 64623354-3285-434f-af62-96ca0d7ce99e roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
92552024-11-19T02:24:40.085ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 64623354-3285-434f-af62-96ca0d7ce99e resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
92562024-11-19T02:24:40.087ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2689 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 64623354-3285-434f-af62-96ca0d7ce99e response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
92572024-11-19T02:24:41.111ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 13c33451-898e-4274-8a79-f1a993e35f36 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
92582024-11-19T02:24:41.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 13c33451-898e-4274-8a79-f1a993e35f36 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
92592024-11-19T02:24:41.114ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3054 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 13c33451-898e-4274-8a79-f1a993e35f36 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
92602024-11-19T02:24:42.138ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 68b9b1e4-d6fd-48a1-a021-f887234c785a roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
92612024-11-19T02:24:42.138ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 68b9b1e4-d6fd-48a1-a021-f887234c785a resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
92622024-11-19T02:24:42.140ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2139 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 68b9b1e4-d6fd-48a1-a021-f887234c785a response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
92632024-11-19T02:24:42.149ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = acf1153a-a608-4438-9272-c140b7f6ddf4 roles = RoleSet { roles: {} } uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?sort_by=id_ascending
92642024-11-19T02:24:42.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = acf1153a-a608-4438-9272-c140b7f6ddf4 resource = Database result = Ok(()) uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?sort_by=id_ascending
92652024-11-19T02:24:42.151ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2458 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = acf1153a-a608-4438-9272-c140b7f6ddf4 response_code = 200 uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?sort_by=id_ascending
92662024-11-19T02:24:42.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = 9eff0205-b8d1-4399-ae6f-34cf5bc0ab21 roles = RoleSet { roles: {} } uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZmU3NDgyNC0wYzA4LTQ4ZTEtYTc1NS1mYjEyM2U4ZGMxODEifX0%3D
92672024-11-19T02:24:42.152ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = 9eff0205-b8d1-4399-ae6f-34cf5bc0ab21 resource = Database result = Ok(()) uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZmU3NDgyNC0wYzA4LTQ4ZTEtYTc1NS1mYjEyM2U4ZGMxODEifX0%3D
92682024-11-19T02:24:42.154ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2512 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = 9eff0205-b8d1-4399-ae6f-34cf5bc0ab21 response_code = 200 uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZmU3NDgyNC0wYzA4LTQ4ZTEtYTc1NS1mYjEyM2U4ZGMxODEifX0%3D
92692024-11-19T02:24:43.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 2970577b-1195-4b8f-b2aa-22d617e6c0aa roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
92702024-11-19T02:24:43.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 2970577b-1195-4b8f-b2aa-22d617e6c0aa resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
92712024-11-19T02:24:43.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2848 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 2970577b-1195-4b8f-b2aa-22d617e6c0aa response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
92722024-11-19T02:24:44.189ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 83c48844-202c-4690-968d-9693fa9ae360 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
92732024-11-19T02:24:44.190ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 83c48844-202c-4690-968d-9693fa9ae360 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
92742024-11-19T02:24:44.192ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2468 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 83c48844-202c-4690-968d-9693fa9ae360 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
92752024-11-19T02:24:44.504ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:51355
92762024-11-19T02:24:44.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:51355 req_id = 3568312c-2375-4553-aa8b-6cd361e43bf5 roles = RoleSet { roles: {} } uri = /metrics/producers
92772024-11-19T02:24:44.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:51355 req_id = 3568312c-2375-4553-aa8b-6cd361e43bf5 resource = Database result = Ok(()) uri = /metrics/producers
92782024-11-19T02:24:44.524ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:58989
92792024-11-19T02:24:44.524ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58989 req_id = b5462800-af0b-4d81-9f99-6fdac87b3b47 roles = RoleSet { roles: {} } uri = /metrics/producers
92802024-11-19T02:24:44.524ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58989 req_id = b5462800-af0b-4d81-9f99-6fdac87b3b47 resource = Database result = Ok(()) uri = /metrics/producers
92812024-11-19T02:24:44.543ZINFOnexus: assigned collector to new producer collector_id = 3980dd20-a3be-40d3-b9e5-094b8ed4b785 file = nexus/src/app/oximeter.rs:76 producer_id = ffe74824-0c08-48e1-a755-fb123e8dc181
92822024-11-19T02:24:44.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38703 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:51355 req_id = 3568312c-2375-4553-aa8b-6cd361e43bf5 response_code = 201 uri = /metrics/producers
92832024-11-19T02:24:44.558ZINFOnexus: assigned collector to new producer collector_id = 3980dd20-a3be-40d3-b9e5-094b8ed4b785 file = nexus/src/app/oximeter.rs:76 producer_id = 4531e85d-d56a-4e09-b4e5-16020bc21701
92842024-11-19T02:24:44.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34475 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58989 req_id = b5462800-af0b-4d81-9f99-6fdac87b3b47 response_code = 201 uri = /metrics/producers
92852024-11-19T02:24:45.189ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:45796
92862024-11-19T02:24:45.190ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45796 req_id = 56e3d348-d85d-4a48-9a37-fcf6385a0ab0 roles = RoleSet { roles: {} } uri = /metrics/producers
92872024-11-19T02:24:45.190ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45796 req_id = 56e3d348-d85d-4a48-9a37-fcf6385a0ab0 resource = Database result = Ok(()) uri = /metrics/producers
92882024-11-19T02:24:45.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0bdd2d3f-24b3-4f49-b8b2-c7847907fab0 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
92892024-11-19T02:24:45.214ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0bdd2d3f-24b3-4f49-b8b2-c7847907fab0 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
92902024-11-19T02:24:45.217ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2512 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0bdd2d3f-24b3-4f49-b8b2-c7847907fab0 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
92912024-11-19T02:24:45.228ZINFOnexus: assigned collector to new producer collector_id = 3980dd20-a3be-40d3-b9e5-094b8ed4b785 file = nexus/src/app/oximeter.rs:76 producer_id = cd87c155-df14-4737-bbdc-04963164d701
92922024-11-19T02:24:45.228ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38074 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45796 req_id = 56e3d348-d85d-4a48-9a37-fcf6385a0ab0 response_code = 201 uri = /metrics/producers
92932024-11-19T02:24:45.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = 99b2642f-db5e-4632-b61d-587fadb7797a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
92942024-11-19T02:24:45.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = 99b2642f-db5e-4632-b61d-587fadb7797a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
92952024-11-19T02:24:45.443ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4173 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43200 req_id = 99b2642f-db5e-4632-b61d-587fadb7797a response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
92962024-11-19T02:24:45.728ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 17 reason = Timeout
92972024-11-19T02:24:45.728ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
92982024-11-19T02:24:45.728ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
92992024-11-19T02:24:45.728ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 16 reason = Timeout
93002024-11-19T02:24:45.728ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-19 02:14:45.728941104 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
93012024-11-19T02:24:45.728ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 17 reason = Timeout
93022024-11-19T02:24:45.728ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
93032024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
93042024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
93052024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 17 reason = Timeout
93062024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 17 reason = Timeout
93072024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 18 reason = Timeout
93082024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 31 reason = Timeout
93092024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
93102024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 17 reason = Timeout
93112024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 31 reason = Timeout
93122024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
93132024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 18 reason = Timeout
93142024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
93152024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
93162024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
93172024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
93182024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 33 reason = Timeout
93192024-11-19T02:24:45.729ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
93202024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 31 reason = Timeout
93212024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 31 reason = Timeout
93222024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
93232024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93242024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 35 reason = Timeout
93252024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93262024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93272024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 31 reason = Timeout
93282024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
93292024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
93302024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 91 reason = Timeout
93312024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 31 reason = Timeout
93322024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93332024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
93342024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 31 reason = Timeout
93352024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 31 reason = Timeout
93362024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93372024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
93382024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 31 reason = Timeout
93392024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
93402024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 16 reason = Timeout
93412024-11-19T02:24:45.729ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
93422024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 7 reason = Timeout
93432024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
93442024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
93452024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
93462024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 91 reason = Timeout
93472024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 31 reason = Timeout
93482024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
93492024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
93502024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
93512024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 16 reason = Timeout
93522024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 17 reason = Timeout
93532024-11-19T02:24:45.729ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115
93542024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
93552024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
93562024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 4 reason = Timeout
93572024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.601\u{b5}s iteration = 17 status = {"enabled":false,"target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115"}
93582024-11-19T02:24:45.729ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
93592024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 31 reason = Timeout
93602024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
93612024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 32 reason = Timeout
93622024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
93632024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93642024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 16 reason = Timeout
93652024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
93662024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 16 reason = Timeout
93672024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
93682024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 31 reason = Timeout
93692024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93702024-11-19T02:24:45.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
93712024-11-19T02:24:45.729ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("27d1a6ca-1b76-4956-aefa-e234c7d60cd0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("91bdcbd0-987b-49c4-8200-fc3e8f332b6b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("91bdcbd0-987b-49c4-8200-fc3e8f332b6b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1783, tv_nsec: 510229331 } })
93722024-11-19T02:24:45.730ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2d59cdb7-e3b1-4e94-afa3-f64f69928234.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a949a8d8-46c7-4423-b760-c03f98ccf638.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b190a9bf-d8b7-43c3-add4-e113c9b89870.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b190a9bf-d8b7-43c3-add4-e113c9b89870.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1783, tv_nsec: 510229431 } })
93732024-11-19T02:24:45.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93742024-11-19T02:24:45.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
93752024-11-19T02:24:45.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93762024-11-19T02:24:45.730ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
93772024-11-19T02:24:45.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
93782024-11-19T02:24:45.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
93792024-11-19T02:24:45.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
93802024-11-19T02:24:45.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
93812024-11-19T02:24:45.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
93822024-11-19T02:24:45.730ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
93832024-11-19T02:24:45.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
93842024-11-19T02:24:45.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93852024-11-19T02:24:45.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93862024-11-19T02:24:45.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
93872024-11-19T02:24:45.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
93882024-11-19T02:24:45.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
93892024-11-19T02:24:45.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
93902024-11-19T02:24:45.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
93912024-11-19T02:24:45.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93922024-11-19T02:24:45.730ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
93932024-11-19T02:24:45.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
93942024-11-19T02:24:45.730ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.293125ms iteration = 17 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
93952024-11-19T02:24:45.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
93962024-11-19T02:24:45.730ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
93972024-11-19T02:24:45.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
93982024-11-19T02:24:45.730ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
93992024-11-19T02:24:45.730ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.465587ms iteration = 17 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
94002024-11-19T02:24:45.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
94012024-11-19T02:24:45.730ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
94022024-11-19T02:24:45.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
94032024-11-19T02:24:45.730ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
94042024-11-19T02:24:45.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
94052024-11-19T02:24:45.730ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
94062024-11-19T02:24:45.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
94072024-11-19T02:24:45.732ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1783, tv_nsec: 512568858 } })
94082024-11-19T02:24:45.732ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
94092024-11-19T02:24:45.732ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94102024-11-19T02:24:45.733ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-19 02:14:45.728941104 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
94112024-11-19T02:24:45.733ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.581092ms iteration = 16 status = {"expiration":"2024-11-19T02:14:45.728941104Z","pruned":[]}
94122024-11-19T02:24:45.734ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1783, tv_nsec: 514613672 } })
94132024-11-19T02:24:45.734ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
94142024-11-19T02:24:45.734ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
94152024-11-19T02:24:45.734ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
94162024-11-19T02:24:45.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
94172024-11-19T02:24:45.736ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.722857ms iteration = 31 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
94182024-11-19T02:24:45.736ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94192024-11-19T02:24:45.738ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
94202024-11-19T02:24:45.738ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
94212024-11-19T02:24:45.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
94222024-11-19T02:24:45.741ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94232024-11-19T02:24:45.741ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
94242024-11-19T02:24:45.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
94252024-11-19T02:24:45.743ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
94262024-11-19T02:24:45.743ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
94272024-11-19T02:24:45.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
94282024-11-19T02:24:45.743ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
94292024-11-19T02:24:45.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
94302024-11-19T02:24:45.745ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
94312024-11-19T02:24:45.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
94322024-11-19T02:24:45.747ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 17.718963ms iteration = 16 status = {"errors":[],"found_port_ok":[]}
94332024-11-19T02:24:45.747ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94342024-11-19T02:24:45.750ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
94352024-11-19T02:24:45.750ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
94362024-11-19T02:24:45.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
94372024-11-19T02:24:45.752ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94382024-11-19T02:24:45.753ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94392024-11-19T02:24:45.757ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
94402024-11-19T02:24:45.757ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
94412024-11-19T02:24:45.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
94422024-11-19T02:24:45.758ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
94432024-11-19T02:24:45.760ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
94442024-11-19T02:24:45.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
94452024-11-19T02:24:45.768ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94462024-11-19T02:24:45.772ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
94472024-11-19T02:24:45.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
94482024-11-19T02:24:45.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
94492024-11-19T02:24:45.774ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94502024-11-19T02:24:45.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94512024-11-19T02:24:45.774ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
94522024-11-19T02:24:45.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
94532024-11-19T02:24:45.776ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 47.080819ms iteration = 91 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
94542024-11-19T02:24:45.777ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
94552024-11-19T02:24:45.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
94562024-11-19T02:24:45.779ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94572024-11-19T02:24:45.781ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 51.56751ms iteration = 31 status = {"errors":[],"garbage_collect_requested":[]}
94582024-11-19T02:24:45.782ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
94592024-11-19T02:24:45.782ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
94602024-11-19T02:24:45.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
94612024-11-19T02:24:45.784ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94622024-11-19T02:24:45.785ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 55.954781ms iteration = 31 status = {"errors":[],"records_set_to_done":[]}
94632024-11-19T02:24:45.785ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94642024-11-19T02:24:45.786ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94652024-11-19T02:24:45.786ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
94662024-11-19T02:24:45.786ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
94672024-11-19T02:24:45.786ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
94682024-11-19T02:24:45.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
94692024-11-19T02:24:45.787ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
94702024-11-19T02:24:45.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
94712024-11-19T02:24:45.788ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94722024-11-19T02:24:45.788ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
94732024-11-19T02:24:45.788ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
94742024-11-19T02:24:45.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
94752024-11-19T02:24:45.789ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
94762024-11-19T02:24:45.789ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94772024-11-19T02:24:45.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94782024-11-19T02:24:45.790ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94792024-11-19T02:24:45.790ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
94802024-11-19T02:24:45.790ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94812024-11-19T02:24:45.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94822024-11-19T02:24:45.791ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
94832024-11-19T02:24:45.791ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94842024-11-19T02:24:45.791ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
94852024-11-19T02:24:45.791ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
94862024-11-19T02:24:45.791ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
94872024-11-19T02:24:45.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94882024-11-19T02:24:45.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
94892024-11-19T02:24:45.792ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94902024-11-19T02:24:45.794ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
94912024-11-19T02:24:45.794ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
94922024-11-19T02:24:45.794ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
94932024-11-19T02:24:45.794ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
94942024-11-19T02:24:45.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
94952024-11-19T02:24:45.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
94962024-11-19T02:24:45.796ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94972024-11-19T02:24:45.796ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
94982024-11-19T02:24:45.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
94992024-11-19T02:24:45.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95002024-11-19T02:24:45.798ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95012024-11-19T02:24:45.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95022024-11-19T02:24:45.799ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ffe74824-0c08-48e1-a755-fb123e8dc181.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1783, tv_nsec: 579462534 } })
95032024-11-19T02:24:45.799ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
95042024-11-19T02:24:45.799ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
95052024-11-19T02:24:45.799ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
95062024-11-19T02:24:45.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
95072024-11-19T02:24:45.801ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
95082024-11-19T02:24:45.801ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95092024-11-19T02:24:45.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95102024-11-19T02:24:45.801ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95112024-11-19T02:24:45.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
95122024-11-19T02:24:45.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
95132024-11-19T02:24:45.802ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
95142024-11-19T02:24:45.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
95152024-11-19T02:24:45.803ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
95162024-11-19T02:24:45.803ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
95172024-11-19T02:24:45.803ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
95182024-11-19T02:24:45.803ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
95192024-11-19T02:24:45.803ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 74.061837ms iteration = 31 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
95202024-11-19T02:24:45.803ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 73.878676ms iteration = 16 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
95212024-11-19T02:24:45.804ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
95222024-11-19T02:24:45.804ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
95232024-11-19T02:24:45.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
95242024-11-19T02:24:45.804ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95252024-11-19T02:24:45.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
95262024-11-19T02:24:45.806ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
95272024-11-19T02:24:45.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
95282024-11-19T02:24:45.808ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
95292024-11-19T02:24:45.808ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
95302024-11-19T02:24:45.808ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
95312024-11-19T02:24:45.808ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
95322024-11-19T02:24:45.808ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
95332024-11-19T02:24:45.808ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
95342024-11-19T02:24:45.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
95352024-11-19T02:24:45.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
95362024-11-19T02:24:45.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
95372024-11-19T02:24:45.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95382024-11-19T02:24:45.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
95392024-11-19T02:24:45.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95402024-11-19T02:24:45.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95412024-11-19T02:24:45.813ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
95422024-11-19T02:24:45.813ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 83.557157ms iteration = 31 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
95432024-11-19T02:24:45.813ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
95442024-11-19T02:24:45.813ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
95452024-11-19T02:24:45.813ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
95462024-11-19T02:24:45.813ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
95472024-11-19T02:24:45.813ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 84.368105ms iteration = 7 status = {"nsuccess":5}
95482024-11-19T02:24:45.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
95492024-11-19T02:24:45.814ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95502024-11-19T02:24:45.815ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95512024-11-19T02:24:45.815ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95522024-11-19T02:24:45.818ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
95532024-11-19T02:24:45.818ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
95542024-11-19T02:24:45.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
95552024-11-19T02:24:45.819ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
95562024-11-19T02:24:45.819ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
95572024-11-19T02:24:45.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
95582024-11-19T02:24:45.819ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
95592024-11-19T02:24:45.819ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
95602024-11-19T02:24:45.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
95612024-11-19T02:24:45.823ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
95622024-11-19T02:24:45.823ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = af79c7eb-bc4d-42f8-9217-8b35affeeebb dns_zone_name = oxide.test found_so_far = 0 version = 2
95632024-11-19T02:24:45.824ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
95642024-11-19T02:24:45.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
95652024-11-19T02:24:45.824ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
95662024-11-19T02:24:45.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
95672024-11-19T02:24:45.825ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
95682024-11-19T02:24:45.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
95692024-11-19T02:24:45.826ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 96.535595ms iteration = 31 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
95702024-11-19T02:24:45.826ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95712024-11-19T02:24:45.827ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
95722024-11-19T02:24:45.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
95732024-11-19T02:24:45.827ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95742024-11-19T02:24:45.829ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
95752024-11-19T02:24:45.829ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
95762024-11-19T02:24:45.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
95772024-11-19T02:24:45.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
95782024-11-19T02:24:45.830ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
95792024-11-19T02:24:45.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
95802024-11-19T02:24:45.831ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
95812024-11-19T02:24:45.831ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 101.957217ms iteration = 91 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
95822024-11-19T02:24:45.831ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95832024-11-19T02:24:45.832ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95842024-11-19T02:24:45.833ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = af79c7eb-bc4d-42f8-9217-8b35affeeebb dns_zone_name = oxide.test found_so_far = 1 version = 2
95852024-11-19T02:24:45.833ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
95862024-11-19T02:24:45.833ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-19 02:10:28.769117 UTC dns_group = external generation = 2
95872024-11-19T02:24:45.833ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 104.308324ms iteration = 17 status = {"generation":2}
95882024-11-19T02:24:45.833ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
95892024-11-19T02:24:45.834ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
95902024-11-19T02:24:45.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
95912024-11-19T02:24:45.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
95922024-11-19T02:24:45.835ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
95932024-11-19T02:24:45.835ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
95942024-11-19T02:24:45.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
95952024-11-19T02:24:45.835ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
95962024-11-19T02:24:45.835ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
95972024-11-19T02:24:45.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
95982024-11-19T02:24:45.837ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95992024-11-19T02:24:45.837ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
96002024-11-19T02:24:45.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
96012024-11-19T02:24:45.838ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
96022024-11-19T02:24:45.838ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
96032024-11-19T02:24:45.838ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 109.132859ms iteration = 16 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
96042024-11-19T02:24:45.839ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
96052024-11-19T02:24:45.839ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
96062024-11-19T02:24:45.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
96072024-11-19T02:24:45.844ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
96082024-11-19T02:24:45.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
96092024-11-19T02:24:45.845ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 116.114869ms iteration = 31 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
96102024-11-19T02:24:45.848ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
96112024-11-19T02:24:45.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
96122024-11-19T02:24:45.852ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
96132024-11-19T02:24:45.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
96142024-11-19T02:24:45.854ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
96152024-11-19T02:24:45.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
96162024-11-19T02:24:45.856ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
96172024-11-19T02:24:45.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
96182024-11-19T02:24:45.857ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 128.344898ms iteration = 31 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
96192024-11-19T02:24:45.858ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
96202024-11-19T02:24:45.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
96212024-11-19T02:24:45.860ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
96222024-11-19T02:24:45.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
96232024-11-19T02:24:45.861ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96242024-11-19T02:24:45.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
96252024-11-19T02:24:45.865ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
96262024-11-19T02:24:45.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
96272024-11-19T02:24:45.866ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
96282024-11-19T02:24:45.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
96292024-11-19T02:24:45.868ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
96302024-11-19T02:24:45.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
96312024-11-19T02:24:45.869ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
96322024-11-19T02:24:45.869ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 8c04fa4d-031f-4603-9b0e-246b45d39276 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
96332024-11-19T02:24:45.869ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
96342024-11-19T02:24:45.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
96352024-11-19T02:24:45.871ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
96362024-11-19T02:24:45.871ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96372024-11-19T02:24:45.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
96382024-11-19T02:24:45.874ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
96392024-11-19T02:24:45.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
96402024-11-19T02:24:45.874ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
96412024-11-19T02:24:45.874ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
96422024-11-19T02:24:45.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
96432024-11-19T02:24:45.876ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
96442024-11-19T02:24:45.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
96452024-11-19T02:24:45.877ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 8c04fa4d-031f-4603-9b0e-246b45d39276 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
96462024-11-19T02:24:45.877ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
96472024-11-19T02:24:45.877ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-19 02:10:27.714570 UTC dns_group = internal generation = 1
96482024-11-19T02:24:45.877ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 148.620392ms iteration = 17 status = {"generation":1}
96492024-11-19T02:24:45.878ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
96502024-11-19T02:24:45.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
96512024-11-19T02:24:45.884ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96522024-11-19T02:24:45.885ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
96532024-11-19T02:24:45.887ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-19T02:09:41.910054Z, time_modified: 2024-11-19T02:09:41.910054Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 78638afa-e975-44a9-b764-0afec18d156f, db_silo: Silo { identity: SiloIdentity { id: 78638afa-e975-44a9-b764-0afec18d156f, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-19T02:10:28.623188Z, time_modified: 2024-11-19T02:10:28.623188Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "fe94815f3f5502a309deafc95cd58d4fe61e984b7bd8ad11309589068beb64f5" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 78638afa-e975-44a9-b764-0afec18d156f, db_silo: Silo { identity: SiloIdentity { id: 78638afa-e975-44a9-b764-0afec18d156f, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-19T02:10:28.623188Z, time_modified: 2024-11-19T02:10:28.623188Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "fe94815f3f5502a309deafc95cd58d4fe61e984b7bd8ad11309589068beb64f5" }] }) }
96542024-11-19T02:24:45.887ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 158.195821ms iteration = 17 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"78638afa-e975-44a9-b764-0afec18d156f","tls_certs":["fe94815f3f5502a309deafc95cd58d4fe61e984b7bd8ad11309589068beb64f5"]}},"default_endpoint":{"silo_id":"78638afa-e975-44a9-b764-0afec18d156f","tls_certs":["fe94815f3f5502a309deafc95cd58d4fe61e984b7bd8ad11309589068beb64f5"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
96552024-11-19T02:24:45.887ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: ffe74824-0c08-48e1-a755-fb123e8dc181, lookup_type: ById(ffe74824-0c08-48e1-a755-fb123e8dc181) } result = Ok(())
96562024-11-19T02:24:45.887ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
96572024-11-19T02:24:45.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
96582024-11-19T02:24:45.888ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 159.412095ms iteration = 31 status = 0
96592024-11-19T02:24:45.902ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
96602024-11-19T02:24:45.902ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
96612024-11-19T02:24:45.902ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b09e9fe5-cfb7-4bbf-905d-67bd6490e3c6", "content-length": "26", "date": "Tue, 19 Nov 2024 02:24:45 GMT"} })
96622024-11-19T02:24:45.902ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
96632024-11-19T02:24:45.905ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
96642024-11-19T02:24:45.908ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
96652024-11-19T02:24:45.908ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 179.159991ms iteration = 16 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
96662024-11-19T02:24:45.911ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 181.951043ms iteration = 35 status = {"physical_disks_added":0}
96672024-11-19T02:24:45.912ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96682024-11-19T02:24:45.916ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
96692024-11-19T02:24:45.916ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
96702024-11-19T02:24:45.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
96712024-11-19T02:24:46.002ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 zone_address = fd00:1122:3344:101::2
96722024-11-19T02:24:46.002ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
96732024-11-19T02:24:46.003ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "99b91fdc-a7c0-4e7a-a27f-71b92feb5c1d", "content-length": "26", "date": "Tue, 19 Nov 2024 02:24:45 GMT"} })
96742024-11-19T02:24:46.003ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
96752024-11-19T02:24:46.005ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
96762024-11-19T02:24:46.080ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
96772024-11-19T02:24:46.108ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
96782024-11-19T02:24:46.109ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
96792024-11-19T02:24:46.109ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
96802024-11-19T02:24:46.109ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4de68609-8dcc-4650-8d41-e8c7aab2e77f", "content-length": "26", "date": "Tue, 19 Nov 2024 02:24:45 GMT"} })
96812024-11-19T02:24:46.109ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
96822024-11-19T02:24:46.119ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
96832024-11-19T02:24:46.123ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 393.970479ms iteration = 31 status = {}
96842024-11-19T02:24:46.166ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
96852024-11-19T02:24:46.167ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "7575c19f-2059-4751-9fc7-6dbb0464d1df", "content-length": "691", "date": "Tue, 19 Nov 2024 02:24:46 GMT"} })
96862024-11-19T02:24:46.167ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
96872024-11-19T02:24:46.167ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
96882024-11-19T02:24:46.167ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
96892024-11-19T02:24:46.169ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 439.432989ms iteration = 32 status = {}
96902024-11-19T02:24:46.233ZINFOnexus (BackgroundTasks): VPC route manager sled ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
96912024-11-19T02:24:46.233ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
96922024-11-19T02:24:46.233ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "537198a7-82b0-408a-aee5-91f6fbdd0fb1", "content-length": "372", "date": "Tue, 19 Nov 2024 02:24:46 GMT"} })
96932024-11-19T02:24:46.233ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
96942024-11-19T02:24:46.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
96952024-11-19T02:24:46.235ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
96962024-11-19T02:24:46.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
96972024-11-19T02:24:46.237ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
96982024-11-19T02:24:46.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
96992024-11-19T02:24:46.240ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97002024-11-19T02:24:46.241ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9cd005ba-19c1-4068-9684-fe5a8f712e5f roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
97012024-11-19T02:24:46.241ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9cd005ba-19c1-4068-9684-fe5a8f712e5f resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
97022024-11-19T02:24:46.242ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1703 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 9cd005ba-19c1-4068-9684-fe5a8f712e5f response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
97032024-11-19T02:24:46.244ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
97042024-11-19T02:24:46.244ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
97052024-11-19T02:24:46.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
97062024-11-19T02:24:46.253ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
97072024-11-19T02:24:46.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
97082024-11-19T02:24:46.256ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
97092024-11-19T02:24:46.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
97102024-11-19T02:24:46.257ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
97112024-11-19T02:24:46.258ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "d2fcd299-94a9-42e3-a540-94fc288e2054", "date": "Tue, 19 Nov 2024 02:24:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
97122024-11-19T02:24:46.258ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
97132024-11-19T02:24:46.258ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
97142024-11-19T02:24:46.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
97152024-11-19T02:24:46.260ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "b0110458-373e-4d5a-a5ea-7d828f770005", "date": "Tue, 19 Nov 2024 02:24:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
97162024-11-19T02:24:46.260ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
97172024-11-19T02:24:46.260ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
97182024-11-19T02:24:46.261ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
97192024-11-19T02:24:46.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
97202024-11-19T02:24:46.261ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "75c4afe9-38a5-43a0-9f99-6be89df7f1a1", "content-length": "2", "date": "Tue, 19 Nov 2024 02:24:45 GMT"} })
97212024-11-19T02:24:46.262ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
97222024-11-19T02:24:46.262ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "54e6c85e-fe4f-465c-be66-e04344bf62f4", "date": "Tue, 19 Nov 2024 02:24:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
97232024-11-19T02:24:46.262ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
97242024-11-19T02:24:46.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
97252024-11-19T02:24:46.263ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
97262024-11-19T02:24:46.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
97272024-11-19T02:24:46.265ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
97282024-11-19T02:24:46.265ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 536.074086ms iteration = 18 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
97292024-11-19T02:24:46.265ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 536.113846ms iteration = 31 status = null
97302024-11-19T02:24:46.265ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
97312024-11-19T02:24:46.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
97322024-11-19T02:24:46.267ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
97332024-11-19T02:24:46.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
97342024-11-19T02:24:46.269ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97352024-11-19T02:24:46.272ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
97362024-11-19T02:24:46.272ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
97372024-11-19T02:24:46.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
97382024-11-19T02:24:46.283ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
97392024-11-19T02:24:46.283ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
97402024-11-19T02:24:46.283ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "681d1872-4679-4005-a368-d23287db218b", "date": "Tue, 19 Nov 2024 02:24:46 GMT"} })
97412024-11-19T02:24:46.283ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97422024-11-19T02:24:46.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97432024-11-19T02:24:46.286ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97442024-11-19T02:24:46.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97452024-11-19T02:24:46.290ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97462024-11-19T02:24:46.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97472024-11-19T02:24:46.294ZINFOnexus (BackgroundTasks): VPC route manager sled ffe74824-0c08-48e1-a755-fb123e8dc181 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
97482024-11-19T02:24:46.294ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
97492024-11-19T02:24:46.294ZDEBGnexus (BackgroundTasks): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
97502024-11-19T02:24:46.294ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "7691e0f9-e76f-47aa-a274-3315eaf0250b", "date": "Tue, 19 Nov 2024 02:24:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
97512024-11-19T02:24:46.294ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
97522024-11-19T02:24:46.294ZDEBGnexus (BackgroundTasks): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "f8a6a938-8338-4869-bc46-c10b797a6af4", "date": "Tue, 19 Nov 2024 02:24:46 GMT"} })
97532024-11-19T02:24:46.297ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 567.694248ms iteration = 33 status = {}
97542024-11-19T02:24:46.297ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "cae49314-03f3-406a-aa57-c00490295d09", "date": "Tue, 19 Nov 2024 02:24:46 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
97552024-11-19T02:24:46.297ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
97562024-11-19T02:24:46.299ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
97572024-11-19T02:24:46.299ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 570.51023ms iteration = 18 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
97582024-11-19T02:24:46.304ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
97592024-11-19T02:24:46.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
97602024-11-19T02:24:46.306ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
97612024-11-19T02:24:46.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
97622024-11-19T02:24:46.307ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97632024-11-19T02:24:46.311ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
97642024-11-19T02:24:46.311ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
97652024-11-19T02:24:46.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
97662024-11-19T02:24:46.318ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 29b1632f-5910-4287-a228-0a2f072906c2, kind: Service { id: f02be878-8b16-4056-a261-089d083d36be }, name: Name("nexus-f02be878-8b16-4056-a261-089d083d36be"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 62])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ace3f45b-d569-4037-91af-4f9560e3857e, kind: Service { id: 9f0b435f-0000-451e-9dbc-dcec71543c30 }, name: Name("nexus-9f0b435f-0000-451e-9dbc-dcec71543c30"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 230])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f794593b-f8ae-411e-9836-93b29d4ba7a6, kind: Service { id: d90c9eb7-7c7e-4675-94ca-7779e9afc6c6 }, name: Name("nexus-d90c9eb7-7c7e-4675-94ca-7779e9afc6c6"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 194])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 1a01f5db-28b0-4d53-93f3-b21792e75a0f, kind: Service { id: 91bdcbd0-987b-49c4-8200-fc3e8f332b6b }, name: Name("external-dns-91bdcbd0-987b-49c4-8200-fc3e8f332b6b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 175])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 44aaf11d-41cc-4bfe-af84-bade0c866c36, kind: Service { id: 27d1a6ca-1b76-4956-aefa-e234c7d60cd0 }, name: Name("external-dns-27d1a6ca-1b76-4956-aefa-e234c7d60cd0"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
97672024-11-19T02:24:46.318ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
97682024-11-19T02:24:46.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
97692024-11-19T02:24:46.322ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97702024-11-19T02:24:46.324ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
97712024-11-19T02:24:46.324ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
97722024-11-19T02:24:46.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
97732024-11-19T02:24:46.327ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
97742024-11-19T02:24:46.327ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 1a01f5db-28b0-4d53-93f3-b21792e75a0f, kind: Service { id: 91bdcbd0-987b-49c4-8200-fc3e8f332b6b }, name: Name("external-dns-91bdcbd0-987b-49c4-8200-fc3e8f332b6b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 175])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 44aaf11d-41cc-4bfe-af84-bade0c866c36, kind: Service { id: 27d1a6ca-1b76-4956-aefa-e234c7d60cd0 }, name: Name("external-dns-27d1a6ca-1b76-4956-aefa-e234c7d60cd0"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 29b1632f-5910-4287-a228-0a2f072906c2, kind: Service { id: f02be878-8b16-4056-a261-089d083d36be }, name: Name("nexus-f02be878-8b16-4056-a261-089d083d36be"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 62])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ace3f45b-d569-4037-91af-4f9560e3857e, kind: Service { id: 9f0b435f-0000-451e-9dbc-dcec71543c30 }, name: Name("nexus-9f0b435f-0000-451e-9dbc-dcec71543c30"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 230])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f794593b-f8ae-411e-9836-93b29d4ba7a6, kind: Service { id: d90c9eb7-7c7e-4675-94ca-7779e9afc6c6 }, name: Name("nexus-d90c9eb7-7c7e-4675-94ca-7779e9afc6c6"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 194])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
97752024-11-19T02:24:46.327ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
97762024-11-19T02:24:46.330ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
97772024-11-19T02:24:46.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
97782024-11-19T02:24:46.332ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 20bc3881-e2ee-4d8d-b84b-b0c1e478721f, rack_id: a894e92e-d765-4f15-b6b7-cb9ca46d1860, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(8597d802-6d4d-4493-88de-333a1f340c20) } rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0
97792024-11-19T02:24:46.332ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
97802024-11-19T02:24:46.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
97812024-11-19T02:24:46.341ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
97822024-11-19T02:24:46.341ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "c7f5e8f1-4d57-42ed-bbc3-193e4910382c", "content-length": "134", "date": "Tue, 19 Nov 2024 02:24:45 GMT"} })
97832024-11-19T02:24:46.341ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
97842024-11-19T02:24:46.341ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 8597d802-6d4d-4493-88de-333a1f340c20
97852024-11-19T02:24:46.342ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
97862024-11-19T02:24:46.342ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
97872024-11-19T02:24:46.342ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
97882024-11-19T02:24:46.342ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
97892024-11-19T02:24:46.342ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
97902024-11-19T02:24:46.342ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
97912024-11-19T02:24:46.342ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
97922024-11-19T02:24:46.342ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
97932024-11-19T02:24:46.342ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860
97942024-11-19T02:24:46.342ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
97952024-11-19T02:24:46.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
97962024-11-19T02:24:46.344ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
97972024-11-19T02:24:46.344ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "f50371be-a7d7-45da-9c20-a739b045ff4e", "content-length": "2", "date": "Tue, 19 Nov 2024 02:24:45 GMT"} })
97982024-11-19T02:24:46.344ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
97992024-11-19T02:24:46.344ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "23c3e893-95c2-4c45-8a0e-6ff7e772a99b", "content-length": "52", "date": "Tue, 19 Nov 2024 02:24:45 GMT"} })
98002024-11-19T02:24:46.344ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch_location = Switch0
98012024-11-19T02:24:46.344ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
98022024-11-19T02:24:46.438ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: ffe74824-0c08-48e1-a755-fb123e8dc181, time_created: 2024-11-19T02:10:26.061586Z, time_modified: 2024-11-19T02:10:26.061586Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: a894e92e-d765-4f15-b6b7-cb9ca46d1860, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::1:0, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
98032024-11-19T02:24:46.438ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
98042024-11-19T02:24:46.438ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
98052024-11-19T02:24:46.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
98062024-11-19T02:24:46.441ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
98072024-11-19T02:24:46.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
98082024-11-19T02:24:46.472ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:50140
98092024-11-19T02:24:46.472ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50140 req_id = b219e702-eedb-43cd-8a5a-7ebe8274b5f2 roles = RoleSet { roles: {} } uri = /metrics/producers
98102024-11-19T02:24:46.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50140 req_id = b219e702-eedb-43cd-8a5a-7ebe8274b5f2 resource = Database result = Ok(()) uri = /metrics/producers
98112024-11-19T02:24:46.476ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98122024-11-19T02:24:46.479ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: ffe74824-0c08-48e1-a755-fb123e8dc181, lookup_type: ById(ffe74824-0c08-48e1-a755-fb123e8dc181) } result = Ok(())
98132024-11-19T02:24:46.485ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "5eaee2ad-fb59-4fd4-a1a3-d7f1c9e0e7e0", "date": "Tue, 19 Nov 2024 02:24:46 GMT"} })
98142024-11-19T02:24:46.485ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 switch = Switch0
98152024-11-19T02:24:46.485ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
98162024-11-19T02:24:46.486ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a894e92e-d765-4f15-b6b7-cb9ca46d1860 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "da418e8d-8d37-40f7-8919-4ee21a74dba4", "content-length": "682", "date": "Tue, 19 Nov 2024 02:24:46 GMT"} })
98172024-11-19T02:24:46.486ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98182024-11-19T02:24:46.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98192024-11-19T02:24:46.509ZINFOnexus: assigned collector to new producer collector_id = 3980dd20-a3be-40d3-b9e5-094b8ed4b785 file = nexus/src/app/oximeter.rs:76 producer_id = 8e12c1ab-c863-4549-add8-1474df60b506
98202024-11-19T02:24:46.509ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36305 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50140 req_id = b219e702-eedb-43cd-8a5a-7ebe8274b5f2 response_code = 201 uri = /metrics/producers
98212024-11-19T02:24:46.511ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
98222024-11-19T02:24:46.514ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = ffe74824-0c08-48e1-a755-fb123e8dc181 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "57e12605-b256-47db-95de-e13e33548944", "date": "Tue, 19 Nov 2024 02:24:46 GMT"} })
98232024-11-19T02:24:46.515ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98242024-11-19T02:24:46.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98252024-11-19T02:24:46.515ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
98262024-11-19T02:24:46.516ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 786.35549ms
98272024-11-19T02:24:46.516ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 786.36411ms iteration = 4 status = {}
98282024-11-19T02:24:46.518ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98292024-11-19T02:24:46.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98302024-11-19T02:24:46.520ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98312024-11-19T02:24:46.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98322024-11-19T02:24:46.528ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 799.055255ms iteration = 31 status = {}
98332024-11-19T02:24:47.269ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 078b48d0-8057-45eb-a02b-dc7a0e560a7a roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
98342024-11-19T02:24:47.269ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 078b48d0-8057-45eb-a02b-dc7a0e560a7a resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
98352024-11-19T02:24:47.271ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2661 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 078b48d0-8057-45eb-a02b-dc7a0e560a7a response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
98362024-11-19T02:24:48.294ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3848dc09-9069-495b-94da-83077ef6fd4d roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
98372024-11-19T02:24:48.295ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3848dc09-9069-495b-94da-83077ef6fd4d resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
98382024-11-19T02:24:48.297ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2272 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 3848dc09-9069-495b-94da-83077ef6fd4d response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
98392024-11-19T02:24:48.829ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:46634
98402024-11-19T02:24:48.829ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:46634 req_id = 77edf58a-7c88-42d3-a2b0-74aeee493755 roles = RoleSet { roles: {} } uri = /metrics/producers
98412024-11-19T02:24:48.830ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:46634 req_id = 77edf58a-7c88-42d3-a2b0-74aeee493755 resource = Database result = Ok(()) uri = /metrics/producers
98422024-11-19T02:24:48.867ZINFOnexus: assigned collector to new producer collector_id = 3980dd20-a3be-40d3-b9e5-094b8ed4b785 file = nexus/src/app/oximeter.rs:76 producer_id = ddf2e18a-a42b-49da-ad7e-ae7886578501
98432024-11-19T02:24:48.867ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37933 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:46634 req_id = 77edf58a-7c88-42d3-a2b0-74aeee493755 response_code = 201 uri = /metrics/producers
98442024-11-19T02:24:48.893ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:44330
98452024-11-19T02:24:48.893ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44330 req_id = 8cf9aa94-e40c-4209-a1d0-ad398326e426 roles = RoleSet { roles: {} } uri = /metrics/producers
98462024-11-19T02:24:48.893ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44330 req_id = 8cf9aa94-e40c-4209-a1d0-ad398326e426 resource = Database result = Ok(()) uri = /metrics/producers
98472024-11-19T02:24:48.930ZINFOnexus: assigned collector to new producer collector_id = 3980dd20-a3be-40d3-b9e5-094b8ed4b785 file = nexus/src/app/oximeter.rs:76 producer_id = 4f0e9442-b890-4bd0-8290-362b3608ea68
98482024-11-19T02:24:48.930ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36806 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44330 req_id = 8cf9aa94-e40c-4209-a1d0-ad398326e426 response_code = 201 uri = /metrics/producers
98492024-11-19T02:24:49.318ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 8f1467c8-427f-43d3-b301-d634c8b59525 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
98502024-11-19T02:24:49.318ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 8f1467c8-427f-43d3-b301-d634c8b59525 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
98512024-11-19T02:24:49.320ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1891 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 8f1467c8-427f-43d3-b301-d634c8b59525 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
98522024-11-19T02:24:50.342ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 2d089a14-eb68-4812-9768-31ce732376f9 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
98532024-11-19T02:24:50.342ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 2d089a14-eb68-4812-9768-31ce732376f9 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
98542024-11-19T02:24:50.344ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2197 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 2d089a14-eb68-4812-9768-31ce732376f9 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
98552024-11-19T02:24:51.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ebb08a84-7424-40ab-9ffc-13e5ca3ce403 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
98562024-11-19T02:24:51.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ebb08a84-7424-40ab-9ffc-13e5ca3ce403 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
98572024-11-19T02:24:51.372ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2801 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ebb08a84-7424-40ab-9ffc-13e5ca3ce403 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
98582024-11-19T02:24:52.157ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1630 local_addr = [fd00:1122:3344:101::c]:60807 method = GET remote_addr = [fd00:1122:3344:101::d]:57844 req_id = 351c4234-ad00-48fb-827c-de4c39aef1a4 response_code = 200 uri = /9f0b435f-0000-451e-9dbc-dcec71543c30
98592024-11-19T02:24:52.395ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 759dbccd-8ffd-49f2-a00f-b9b3e5bafb37 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
98602024-11-19T02:24:52.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 759dbccd-8ffd-49f2-a00f-b9b3e5bafb37 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
98612024-11-19T02:24:52.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2408 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 759dbccd-8ffd-49f2-a00f-b9b3e5bafb37 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
98622024-11-19T02:24:53.421ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 67cdcb04-7ab6-4154-a6a0-5fddc2c4f030 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
98632024-11-19T02:24:53.421ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 67cdcb04-7ab6-4154-a6a0-5fddc2c4f030 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
98642024-11-19T02:24:53.423ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2082 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 67cdcb04-7ab6-4154-a6a0-5fddc2c4f030 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
98652024-11-19T02:24:54.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = bcc5a22e-5ca6-496e-b293-7e6cc11de734 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
98662024-11-19T02:24:54.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = bcc5a22e-5ca6-496e-b293-7e6cc11de734 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
98672024-11-19T02:24:54.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2824 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = bcc5a22e-5ca6-496e-b293-7e6cc11de734 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
98682024-11-19T02:24:55.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4e90ae61-55c1-4f92-ab9d-1582e82a73f6 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
98692024-11-19T02:24:55.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4e90ae61-55c1-4f92-ab9d-1582e82a73f6 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
98702024-11-19T02:24:55.471ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2966 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 4e90ae61-55c1-4f92-ab9d-1582e82a73f6 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
98712024-11-19T02:24:55.730ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 92 reason = Timeout
98722024-11-19T02:24:55.730ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 92 reason = Timeout
98732024-11-19T02:24:55.730ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
98742024-11-19T02:24:55.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98752024-11-19T02:24:55.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98762024-11-19T02:24:55.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
98772024-11-19T02:24:55.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98782024-11-19T02:24:55.733ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
98792024-11-19T02:24:55.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
98802024-11-19T02:24:55.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
98812024-11-19T02:24:55.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98822024-11-19T02:24:55.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98832024-11-19T02:24:55.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98842024-11-19T02:24:55.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98852024-11-19T02:24:55.738ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98862024-11-19T02:24:55.741ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
98872024-11-19T02:24:55.741ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98882024-11-19T02:24:55.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98892024-11-19T02:24:55.754ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
98902024-11-19T02:24:55.754ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.085546ms iteration = 92 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
98912024-11-19T02:24:55.762ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.702255ms iteration = 92 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
98922024-11-19T02:24:56.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 078b4a44-2f05-49b9-937a-43067b9b2b4e roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
98932024-11-19T02:24:56.494ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 078b4a44-2f05-49b9-937a-43067b9b2b4e resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
98942024-11-19T02:24:56.496ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2276 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 078b4a44-2f05-49b9-937a-43067b9b2b4e response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
98952024-11-19T02:24:57.149ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = 01fb2d0d-0e9f-4a0c-b2c6-29952142e477 roles = RoleSet { roles: {} } uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?sort_by=id_ascending
98962024-11-19T02:24:57.150ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = 01fb2d0d-0e9f-4a0c-b2c6-29952142e477 resource = Database result = Ok(()) uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?sort_by=id_ascending
98972024-11-19T02:24:57.153ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3611 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = 01fb2d0d-0e9f-4a0c-b2c6-29952142e477 response_code = 200 uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?sort_by=id_ascending
98982024-11-19T02:24:57.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = 36667b1c-e83a-4e10-8cdd-c7d1f0117607 roles = RoleSet { roles: {} } uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZmU3NDgyNC0wYzA4LTQ4ZTEtYTc1NS1mYjEyM2U4ZGMxODEifX0%3D
98992024-11-19T02:24:57.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = 36667b1c-e83a-4e10-8cdd-c7d1f0117607 resource = Database result = Ok(()) uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZmU3NDgyNC0wYzA4LTQ4ZTEtYTc1NS1mYjEyM2U4ZGMxODEifX0%3D
99002024-11-19T02:24:57.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2366 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48845 req_id = 36667b1c-e83a-4e10-8cdd-c7d1f0117607 response_code = 200 uri = /metrics/collectors/3980dd20-a3be-40d3-b9e5-094b8ed4b785/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZmU3NDgyNC0wYzA4LTQ4ZTEtYTc1NS1mYjEyM2U4ZGMxODEifX0%3D
99012024-11-19T02:24:57.517ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 7755a787-fb8f-48fb-94dd-b698d4a24057 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
99022024-11-19T02:24:57.517ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 7755a787-fb8f-48fb-94dd-b698d4a24057 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
99032024-11-19T02:24:57.519ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2267 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 7755a787-fb8f-48fb-94dd-b698d4a24057 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
99042024-11-19T02:24:58.542ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 7cab6148-4fd0-4f7c-a214-b562af5f17dd roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
99052024-11-19T02:24:58.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 7cab6148-4fd0-4f7c-a214-b562af5f17dd resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
99062024-11-19T02:24:58.544ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2317 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 7cab6148-4fd0-4f7c-a214-b562af5f17dd response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
99072024-11-19T02:24:59.566ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ed895232-fa3c-4604-a7ab-4fef581e053d roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
99082024-11-19T02:24:59.567ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ed895232-fa3c-4604-a7ab-4fef581e053d resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
99092024-11-19T02:24:59.568ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2055 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = ed895232-fa3c-4604-a7ab-4fef581e053d response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
99102024-11-19T02:25:00.591ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0998abe1-14fd-4ded-8f7c-8f44ca24c573 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
99112024-11-19T02:25:00.592ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0998abe1-14fd-4ded-8f7c-8f44ca24c573 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
99122024-11-19T02:25:00.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2023 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 0998abe1-14fd-4ded-8f7c-8f44ca24c573 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
99132024-11-19T02:25:01.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d7f92c66-50fd-4260-8737-157e3f1aa85f roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
99142024-11-19T02:25:01.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d7f92c66-50fd-4260-8737-157e3f1aa85f resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
99152024-11-19T02:25:01.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2228 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = d7f92c66-50fd-4260-8737-157e3f1aa85f response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
99162024-11-19T02:25:02.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 64b3738c-107c-4eca-bfda-a267c5b38985 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
99172024-11-19T02:25:02.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 64b3738c-107c-4eca-bfda-a267c5b38985 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
99182024-11-19T02:25:02.642ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2500 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 64b3738c-107c-4eca-bfda-a267c5b38985 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
99192024-11-19T02:25:03.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b6004d3e-b8c5-4d8f-9ae8-a3dd9b7c900d roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
99202024-11-19T02:25:03.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b6004d3e-b8c5-4d8f-9ae8-a3dd9b7c900d resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
99212024-11-19T02:25:03.669ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2800 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b6004d3e-b8c5-4d8f-9ae8-a3dd9b7c900d response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
99222024-11-19T02:25:04.691ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b3e92471-7113-4714-b51d-0c0964e00182 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
99232024-11-19T02:25:04.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b3e92471-7113-4714-b51d-0c0964e00182 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
99242024-11-19T02:25:04.693ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2454 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b3e92471-7113-4714-b51d-0c0964e00182 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
99252024-11-19T02:25:05.714ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = bb6c13d7-d2fe-447c-9076-49ba91f35d34 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
99262024-11-19T02:25:05.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = bb6c13d7-d2fe-447c-9076-49ba91f35d34 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
99272024-11-19T02:25:05.716ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2158 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = bb6c13d7-d2fe-447c-9076-49ba91f35d34 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
99282024-11-19T02:25:05.729ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 93 reason = Timeout
99292024-11-19T02:25:05.729ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 93 reason = Timeout
99302024-11-19T02:25:05.729ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99312024-11-19T02:25:05.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99322024-11-19T02:25:05.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99332024-11-19T02:25:05.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99342024-11-19T02:25:05.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99352024-11-19T02:25:05.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
99362024-11-19T02:25:05.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99372024-11-19T02:25:05.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99382024-11-19T02:25:05.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99392024-11-19T02:25:05.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99402024-11-19T02:25:05.739ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99412024-11-19T02:25:05.741ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8f818ae5-d130-41a2-9678-88fbc87cf115, lookup_type: ById(8f818ae5-d130-41a2-9678-88fbc87cf115) } result = Ok(())
99422024-11-19T02:25:05.741ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99432024-11-19T02:25:05.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99442024-11-19T02:25:05.754ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 original_time_created = 2024-11-19 02:09:35.029573 UTC target_id = 8f818ae5-d130-41a2-9678-88fbc87cf115 time_created = 2024-11-19 02:09:35.029573 UTC
99452024-11-19T02:25:05.754ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.877744ms iteration = 93 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8f818ae5-d130-41a2-9678-88fbc87cf115","time_created":"2024-11-19T02:09:35.029573Z"}
99462024-11-19T02:25:05.760ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99472024-11-19T02:25:05.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99482024-11-19T02:25:05.790ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.628223ms iteration = 93 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
99492024-11-19T02:25:06.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 58a50d66-3ec5-4e07-8a4a-fbaa42f00099 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
99502024-11-19T02:25:06.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 58a50d66-3ec5-4e07-8a4a-fbaa42f00099 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
99512024-11-19T02:25:06.742ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2191 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 58a50d66-3ec5-4e07-8a4a-fbaa42f00099 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
99522024-11-19T02:25:07.158ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1366 local_addr = [fd00:1122:3344:101::c]:60807 method = GET remote_addr = [fd00:1122:3344:101::d]:57844 req_id = 61affd27-fa42-4076-9654-cb7d2e72fd3e response_code = 200 uri = /9f0b435f-0000-451e-9dbc-dcec71543c30
99532024-11-19T02:25:07.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 42ec8b74-b8a6-4f45-9805-5787627b9e06 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
99542024-11-19T02:25:07.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 42ec8b74-b8a6-4f45-9805-5787627b9e06 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
99552024-11-19T02:25:07.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2692 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = 42ec8b74-b8a6-4f45-9805-5787627b9e06 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
99562024-11-19T02:25:08.791ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b7608677-3ed0-478f-97df-6fd93d6258a0 roles = RoleSet { roles: {} } uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
99572024-11-19T02:25:08.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b7608677-3ed0-478f-97df-6fd93d6258a0 resource = Database result = Ok(()) uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181
99582024-11-19T02:25:08.793ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2170 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:47082 req_id = b7608677-3ed0-478f-97df-6fd93d6258a0 response_code = 200 uri = /probes/ffe74824-0c08-48e1-a755-fb123e8dc181