Max level shown:
12024-11-14T06:30:01.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 8f4a97c5-2cb7-4fd7-ab06-6c3ce28b5f77 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
22024-11-14T06:30:01.268ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 8f4a97c5-2cb7-4fd7-ab06-6c3ce28b5f77 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
32024-11-14T06:30:01.270ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2748 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 8f4a97c5-2cb7-4fd7-ab06-6c3ce28b5f77 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
42024-11-14T06:30:02.302ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 8e4572ea-2a71-4d31-bfab-042003cd1e42 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
52024-11-14T06:30:02.302ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 8e4572ea-2a71-4d31-bfab-042003cd1e42 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
62024-11-14T06:30:02.304ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2516 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 8e4572ea-2a71-4d31-bfab-042003cd1e42 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
72024-11-14T06:30:03.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 85ede1fc-4ff6-460e-95e0-6c1a309e4170 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
82024-11-14T06:30:03.327ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 85ede1fc-4ff6-460e-95e0-6c1a309e4170 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
92024-11-14T06:30:03.329ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2081 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 85ede1fc-4ff6-460e-95e0-6c1a309e4170 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
102024-11-14T06:30:04.350ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = e85b22e0-c382-44d0-a0f8-46b0e4c16f33 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
112024-11-14T06:30:04.350ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = e85b22e0-c382-44d0-a0f8-46b0e4c16f33 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
122024-11-14T06:30:04.352ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2214 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = e85b22e0-c382-44d0-a0f8-46b0e4c16f33 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
132024-11-14T06:30:05.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 20ed58fa-050f-4d27-80f1-7383d51e29c9 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
142024-11-14T06:30:05.373ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 20ed58fa-050f-4d27-80f1-7383d51e29c9 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
152024-11-14T06:30:05.375ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2100 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 20ed58fa-050f-4d27-80f1-7383d51e29c9 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
162024-11-14T06:30:06.395ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 8782c894-781c-42f3-b420-adb1f538d5ec roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
172024-11-14T06:30:06.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 8782c894-781c-42f3-b420-adb1f538d5ec resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
182024-11-14T06:30:06.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2785 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 8782c894-781c-42f3-b420-adb1f538d5ec response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
192024-11-14T06:30:07.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 7999b21d-4625-4e2a-a660-27749c4ce973 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
202024-11-14T06:30:07.419ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 7999b21d-4625-4e2a-a660-27749c4ce973 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
212024-11-14T06:30:07.421ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2517 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 7999b21d-4625-4e2a-a660-27749c4ce973 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
222024-11-14T06:30:07.606ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 578 local_addr = [fd00:1122:3344:101::c]:60882 method = GET remote_addr = [fd00:1122:3344:101::d]:64488 req_id = f7d07534-76d5-48be-8218-05b017446da1 response_code = 200 uri = /80190dc3-d884-49a0-b9a3-38d31e8c655a
232024-11-14T06:30:08.442ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 85f6e08b-9511-4332-9097-1507254175a8 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
242024-11-14T06:30:08.442ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 85f6e08b-9511-4332-9097-1507254175a8 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
252024-11-14T06:30:08.444ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2244 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 85f6e08b-9511-4332-9097-1507254175a8 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
262024-11-14T06:30:09.465ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 994a8692-4f1b-4d4e-be80-857805e2419b roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
272024-11-14T06:30:09.465ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 994a8692-4f1b-4d4e-be80-857805e2419b resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
282024-11-14T06:30:09.467ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2186 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 994a8692-4f1b-4d4e-be80-857805e2419b response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
292024-11-14T06:30:09.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
302024-11-14T06:30:09.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
312024-11-14T06:30:09.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
322024-11-14T06:30:09.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
332024-11-14T06:30:09.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
342024-11-14T06:30:09.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
352024-11-14T06:30:09.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
362024-11-14T06:30:09.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
372024-11-14T06:30:09.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
382024-11-14T06:30:09.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
392024-11-14T06:30:09.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
402024-11-14T06:30:09.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
412024-11-14T06:30:09.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
422024-11-14T06:30:09.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
432024-11-14T06:30:09.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
442024-11-14T06:30:09.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
452024-11-14T06:30:09.596ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
462024-11-14T06:30:09.596ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.474929ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
472024-11-14T06:30:09.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
482024-11-14T06:30:09.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
492024-11-14T06:30:09.629ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.480102ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
502024-11-14T06:30:10.488ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 06d59cf2-56a1-4b17-9ca9-d99e687c7e21 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
512024-11-14T06:30:10.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 06d59cf2-56a1-4b17-9ca9-d99e687c7e21 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
522024-11-14T06:30:10.490ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2108 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 06d59cf2-56a1-4b17-9ca9-d99e687c7e21 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
532024-11-14T06:30:11.511ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = eb2d7a73-5723-4e58-8173-50cdf9328ddb roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
542024-11-14T06:30:11.511ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = eb2d7a73-5723-4e58-8173-50cdf9328ddb resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
552024-11-14T06:30:11.513ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2328 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = eb2d7a73-5723-4e58-8173-50cdf9328ddb response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
562024-11-14T06:30:12.534ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 97479e9c-0fda-4ac6-ae33-d732d92a640c roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
572024-11-14T06:30:12.534ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 97479e9c-0fda-4ac6-ae33-d732d92a640c resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
582024-11-14T06:30:12.536ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2027 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 97479e9c-0fda-4ac6-ae33-d732d92a640c response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
592024-11-14T06:30:13.557ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 28611298-4e7c-4795-99e7-15cc45b3ed57 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
602024-11-14T06:30:13.557ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 28611298-4e7c-4795-99e7-15cc45b3ed57 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
612024-11-14T06:30:13.559ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2320 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 28611298-4e7c-4795-99e7-15cc45b3ed57 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
622024-11-14T06:30:14.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 41474c11-b9f0-4c01-88bc-a86ab698905c roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
632024-11-14T06:30:14.580ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 41474c11-b9f0-4c01-88bc-a86ab698905c resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
642024-11-14T06:30:14.582ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2655 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 41474c11-b9f0-4c01-88bc-a86ab698905c response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
652024-11-14T06:30:15.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = d2e91fe4-1f1e-44f5-9a2a-f8b5d64d8963 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
662024-11-14T06:30:15.603ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = d2e91fe4-1f1e-44f5-9a2a-f8b5d64d8963 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
672024-11-14T06:30:15.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1879 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = d2e91fe4-1f1e-44f5-9a2a-f8b5d64d8963 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
682024-11-14T06:30:16.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 8a2ff040-5b05-4641-b563-a08dfee168d7 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
692024-11-14T06:30:16.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 8a2ff040-5b05-4641-b563-a08dfee168d7 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
702024-11-14T06:30:16.628ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2429 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 8a2ff040-5b05-4641-b563-a08dfee168d7 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
712024-11-14T06:30:17.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 89890d7b-c695-4086-80b9-fa1c8032c62d roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
722024-11-14T06:30:17.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 89890d7b-c695-4086-80b9-fa1c8032c62d resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
732024-11-14T06:30:17.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1995 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 89890d7b-c695-4086-80b9-fa1c8032c62d response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
742024-11-14T06:30:18.671ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 128cdb9b-0d49-42dd-93a6-34974dd6d82f roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
752024-11-14T06:30:18.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 128cdb9b-0d49-42dd-93a6-34974dd6d82f resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
762024-11-14T06:30:18.673ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2426 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 128cdb9b-0d49-42dd-93a6-34974dd6d82f response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
772024-11-14T06:30:19.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
782024-11-14T06:30:19.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
792024-11-14T06:30:19.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
802024-11-14T06:30:19.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
812024-11-14T06:30:19.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
822024-11-14T06:30:19.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
832024-11-14T06:30:19.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
842024-11-14T06:30:19.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
852024-11-14T06:30:19.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
862024-11-14T06:30:19.577ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.361392ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
872024-11-14T06:30:19.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
882024-11-14T06:30:19.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
892024-11-14T06:30:19.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
902024-11-14T06:30:19.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
912024-11-14T06:30:19.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
922024-11-14T06:30:19.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
932024-11-14T06:30:19.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
942024-11-14T06:30:19.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
952024-11-14T06:30:19.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
962024-11-14T06:30:19.594ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
972024-11-14T06:30:19.594ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.571393ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
982024-11-14T06:30:19.694ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = c45ac819-7b64-4569-8a1d-705e26cb047d roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
992024-11-14T06:30:19.694ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = c45ac819-7b64-4569-8a1d-705e26cb047d resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
1002024-11-14T06:30:19.696ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2031 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = c45ac819-7b64-4569-8a1d-705e26cb047d response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
1012024-11-14T06:30:20.717ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 9a5b4024-ef75-4133-9f07-bafc1a09b681 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
1022024-11-14T06:30:20.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 9a5b4024-ef75-4133-9f07-bafc1a09b681 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
1032024-11-14T06:30:20.719ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2289 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 9a5b4024-ef75-4133-9f07-bafc1a09b681 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
1042024-11-14T06:30:21.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = d3fd6664-acae-4142-8dda-415e75893efb roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
1052024-11-14T06:30:21.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = d3fd6664-acae-4142-8dda-415e75893efb resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
1062024-11-14T06:30:21.742ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2066 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = d3fd6664-acae-4142-8dda-415e75893efb response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
1072024-11-14T06:30:22.605ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 549 local_addr = [fd00:1122:3344:101::c]:60882 method = GET remote_addr = [fd00:1122:3344:101::d]:64488 req_id = 97c83abc-2617-4168-a0ee-b9b4ec845467 response_code = 200 uri = /80190dc3-d884-49a0-b9a3-38d31e8c655a
1082024-11-14T06:30:22.763ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f2db4e67-0f71-49dd-a5fe-71c0c1808716 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
1092024-11-14T06:30:22.763ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f2db4e67-0f71-49dd-a5fe-71c0c1808716 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
1102024-11-14T06:30:22.765ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2119 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f2db4e67-0f71-49dd-a5fe-71c0c1808716 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
1112024-11-14T06:30:23.786ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = d63d2fa2-7531-40bf-bd6a-8d4948ed79d1 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
1122024-11-14T06:30:23.786ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = d63d2fa2-7531-40bf-bd6a-8d4948ed79d1 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
1132024-11-14T06:30:23.788ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2492 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = d63d2fa2-7531-40bf-bd6a-8d4948ed79d1 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
1142024-11-14T06:30:24.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 550e8ae4-8f2a-4fec-9d49-b822fe1abb80 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
1152024-11-14T06:30:24.810ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 550e8ae4-8f2a-4fec-9d49-b822fe1abb80 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
1162024-11-14T06:30:24.812ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2517 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 550e8ae4-8f2a-4fec-9d49-b822fe1abb80 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
1172024-11-14T06:30:25.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 8825f3e7-e283-446a-b986-dea8ef31c4d8 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
1182024-11-14T06:30:25.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 8825f3e7-e283-446a-b986-dea8ef31c4d8 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
1192024-11-14T06:30:25.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2562 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 8825f3e7-e283-446a-b986-dea8ef31c4d8 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
1202024-11-14T06:30:26.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 987dff27-45ca-4075-b8a3-0cff493543b2 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
1212024-11-14T06:30:26.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 987dff27-45ca-4075-b8a3-0cff493543b2 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
1222024-11-14T06:30:26.856ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1986 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 987dff27-45ca-4075-b8a3-0cff493543b2 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
1232024-11-14T06:30:27.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 03679bdc-bf96-48e1-b763-c54ea738a725 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
1242024-11-14T06:30:27.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 03679bdc-bf96-48e1-b763-c54ea738a725 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
1252024-11-14T06:30:27.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2583 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 03679bdc-bf96-48e1-b763-c54ea738a725 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
1262024-11-14T06:30:28.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 524e6028-6409-4a60-bc28-fb2caef66ec9 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
1272024-11-14T06:30:28.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 524e6028-6409-4a60-bc28-fb2caef66ec9 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
1282024-11-14T06:30:28.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2000 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 524e6028-6409-4a60-bc28-fb2caef66ec9 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
1292024-11-14T06:30:29.573ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
1302024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
1312024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
1322024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1332024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1342024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1352024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
1362024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
1372024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
1382024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
1392024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
1402024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1412024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
1422024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
1432024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1442024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
1452024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
1462024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
1472024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
1482024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
1492024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
1502024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
1512024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
1522024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
1532024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
1542024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
1552024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1562024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
1572024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
1582024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
1592024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1602024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
1612024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
1622024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1632024-11-14T06:30:29.574ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 1d98d624-72d4-4466-8fe7-990461a3f886
1642024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
1652024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 16.411\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"1d98d624-72d4-4466-8fe7-990461a3f886"}
1662024-11-14T06:30:29.574ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 06:20:29.574226462 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
1672024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
1682024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
1692024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
1702024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
1712024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1722024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
1732024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
1742024-11-14T06:30:29.574ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
1752024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
1762024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1772024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1782024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1792024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
1802024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1812024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1822024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1832024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
1842024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
1852024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1862024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1872024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1882024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1892024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1902024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
1912024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
1922024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
1932024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
1942024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
1952024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
1962024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
1972024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1982024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
1992024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
2002024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
2012024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
2022024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2032024-11-14T06:30:29.574ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
2042024-11-14T06:30:29.574ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("720ac48b-8596-4763-a661-482d124c0a16.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f40de7f6-4bc1-4578-baeb-b08e777b4bed.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f40de7f6-4bc1-4578-baeb-b08e777b4bed.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1686, tv_nsec: 132927535 } })
2052024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2062024-11-14T06:30:29.574ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("36c202a9-b541-4083-88f5-ff6483340b34.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("78c1624f-34e7-40fb-a468-bb6354445b73.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d40cb6d7-78a4-49d0-ae26-45907e21e06a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d40cb6d7-78a4-49d0-ae26-45907e21e06a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1686, tv_nsec: 132927565 } })
2072024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
2082024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
2092024-11-14T06:30:29.574ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
2102024-11-14T06:30:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
2112024-11-14T06:30:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2122024-11-14T06:30:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
2132024-11-14T06:30:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
2142024-11-14T06:30:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
2152024-11-14T06:30:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2162024-11-14T06:30:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
2172024-11-14T06:30:29.575ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
2182024-11-14T06:30:29.575ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.115671ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
2192024-11-14T06:30:29.575ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
2202024-11-14T06:30:29.575ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.254143ms iteration = 12 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
2212024-11-14T06:30:29.576ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2222024-11-14T06:30:29.576ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2232024-11-14T06:30:29.577ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.143069ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
2242024-11-14T06:30:29.578ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2252024-11-14T06:30:29.578ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1686, tv_nsec: 137059262 } })
2262024-11-14T06:30:29.579ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
2272024-11-14T06:30:29.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2282024-11-14T06:30:29.580ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2292024-11-14T06:30:29.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
2302024-11-14T06:30:29.580ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2312024-11-14T06:30:29.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2322024-11-14T06:30:29.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2332024-11-14T06:30:29.582ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
2342024-11-14T06:30:29.582ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2352024-11-14T06:30:29.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2362024-11-14T06:30:29.582ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2372024-11-14T06:30:29.583ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2382024-11-14T06:30:29.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2392024-11-14T06:30:29.583ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
2402024-11-14T06:30:29.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
2412024-11-14T06:30:29.584ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1686, tv_nsec: 142530584 } })
2422024-11-14T06:30:29.584ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
2432024-11-14T06:30:29.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2442024-11-14T06:30:29.585ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
2452024-11-14T06:30:29.585ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2462024-11-14T06:30:29.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2472024-11-14T06:30:29.586ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2482024-11-14T06:30:29.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2492024-11-14T06:30:29.588ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2502024-11-14T06:30:29.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
2512024-11-14T06:30:29.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2522024-11-14T06:30:29.588ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2532024-11-14T06:30:29.588ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
2542024-11-14T06:30:29.588ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2552024-11-14T06:30:29.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2562024-11-14T06:30:29.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2572024-11-14T06:30:29.590ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 06:20:29.574226462 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
2582024-11-14T06:30:29.590ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 16.402135ms iteration = 12 status = {"expiration":"2024-11-14T06:20:29.574226462Z","pruned":[]}
2592024-11-14T06:30:29.590ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2602024-11-14T06:30:29.590ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
2612024-11-14T06:30:29.590ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
2622024-11-14T06:30:29.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
2632024-11-14T06:30:29.593ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
2642024-11-14T06:30:29.593ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
2652024-11-14T06:30:29.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
2662024-11-14T06:30:29.596ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 21.716864ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
2672024-11-14T06:30:29.596ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
2682024-11-14T06:30:29.596ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
2692024-11-14T06:30:29.596ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 21.768935ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
2702024-11-14T06:30:29.597ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2712024-11-14T06:30:29.597ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
2722024-11-14T06:30:29.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
2732024-11-14T06:30:29.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2742024-11-14T06:30:29.598ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2752024-11-14T06:30:29.598ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 24.525807ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
2762024-11-14T06:30:29.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2772024-11-14T06:30:29.599ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1686, tv_nsec: 157259578 } })
2782024-11-14T06:30:29.599ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
2792024-11-14T06:30:29.601ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 26.387151ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
2802024-11-14T06:30:29.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2812024-11-14T06:30:29.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2822024-11-14T06:30:29.609ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2832024-11-14T06:30:29.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2842024-11-14T06:30:29.611ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2852024-11-14T06:30:29.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
2862024-11-14T06:30:29.615ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2872024-11-14T06:30:29.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2882024-11-14T06:30:29.632ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2892024-11-14T06:30:29.637ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
2902024-11-14T06:30:29.637ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2912024-11-14T06:30:29.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2922024-11-14T06:30:29.640ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
2932024-11-14T06:30:29.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
2942024-11-14T06:30:29.643ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 69.708687ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
2952024-11-14T06:30:29.653ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2962024-11-14T06:30:29.657ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2972024-11-14T06:30:29.657ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2982024-11-14T06:30:29.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2992024-11-14T06:30:29.657ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
3002024-11-14T06:30:29.657ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 83.414722ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
3012024-11-14T06:30:29.657ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3022024-11-14T06:30:29.657ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
3032024-11-14T06:30:29.657ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
3042024-11-14T06:30:29.658ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
3052024-11-14T06:30:29.658ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 83.489454ms iteration = 23 status = {"errors":[],"records_set_to_done":[]}
3062024-11-14T06:30:29.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
3072024-11-14T06:30:29.659ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3082024-11-14T06:30:29.662ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
3092024-11-14T06:30:29.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
3102024-11-14T06:30:29.662ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
3112024-11-14T06:30:29.662ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3122024-11-14T06:30:29.662ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
3132024-11-14T06:30:29.662ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3142024-11-14T06:30:29.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3152024-11-14T06:30:29.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3162024-11-14T06:30:29.663ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3172024-11-14T06:30:29.665ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
3182024-11-14T06:30:29.665ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
3192024-11-14T06:30:29.665ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
3202024-11-14T06:30:29.665ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3212024-11-14T06:30:29.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3222024-11-14T06:30:29.665ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
3232024-11-14T06:30:29.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
3242024-11-14T06:30:29.666ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
3252024-11-14T06:30:29.666ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
3262024-11-14T06:30:29.666ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 91.930371ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
3272024-11-14T06:30:29.667ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
3282024-11-14T06:30:29.667ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3292024-11-14T06:30:29.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3302024-11-14T06:30:29.669ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
3312024-11-14T06:30:29.669ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
3322024-11-14T06:30:29.669ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
3332024-11-14T06:30:29.669ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3342024-11-14T06:30:29.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3352024-11-14T06:30:29.670ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3362024-11-14T06:30:29.670ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3372024-11-14T06:30:29.670ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 96.066838ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
3382024-11-14T06:30:29.671ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3392024-11-14T06:30:29.674ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
3402024-11-14T06:30:29.674ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3412024-11-14T06:30:29.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3422024-11-14T06:30:29.674ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 27a56cb4-44ff-4d5b-931e-1c2c0642844d, lookup_type: ById(27a56cb4-44ff-4d5b-931e-1c2c0642844d) } result = Ok(())
3432024-11-14T06:30:29.674ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3442024-11-14T06:30:29.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3452024-11-14T06:30:29.675ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
3462024-11-14T06:30:29.675ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3472024-11-14T06:30:29.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3482024-11-14T06:30:29.676ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
3492024-11-14T06:30:29.676ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 102.047629ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
3502024-11-14T06:30:29.677ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3512024-11-14T06:30:29.677ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
3522024-11-14T06:30:29.677ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
3532024-11-14T06:30:29.677ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 103.328823ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
3542024-11-14T06:30:29.679ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 104.381892ms iteration = 23 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
3552024-11-14T06:30:29.679ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
3562024-11-14T06:30:29.679ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
3572024-11-14T06:30:29.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
3582024-11-14T06:30:29.680ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 106.196536ms iteration = 23 status = 0
3592024-11-14T06:30:29.686ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
3602024-11-14T06:30:29.686ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 30e11b92-f705-4c8e-bce7-d646f8ce00cf dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
3612024-11-14T06:30:29.686ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3622024-11-14T06:30:29.686ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3632024-11-14T06:30:29.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3642024-11-14T06:30:29.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3652024-11-14T06:30:29.694ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
3662024-11-14T06:30:29.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
3672024-11-14T06:30:29.719ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
3682024-11-14T06:30:29.719ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = c6d59938-b455-4e7b-9d17-0d6427a65b9c dns_zone_name = oxide.test found_so_far = 0 version = 2
3692024-11-14T06:30:29.719ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3702024-11-14T06:30:29.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3712024-11-14T06:30:29.730ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 156.607105ms iteration = 26 status = {"physical_disks_added":0}
3722024-11-14T06:30:29.739ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3732024-11-14T06:30:29.741ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
3742024-11-14T06:30:29.741ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3752024-11-14T06:30:29.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3762024-11-14T06:30:29.742ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
3772024-11-14T06:30:29.743ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
3782024-11-14T06:30:29.756ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3792024-11-14T06:30:29.760ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
3802024-11-14T06:30:29.760ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3812024-11-14T06:30:29.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3822024-11-14T06:30:29.763ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 30e11b92-f705-4c8e-bce7-d646f8ce00cf dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
3832024-11-14T06:30:29.763ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
3842024-11-14T06:30:29.763ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-14 06:19:30.340423 UTC dns_group = internal generation = 1
3852024-11-14T06:30:29.763ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 189.244163ms iteration = 12 status = {"generation":1}
3862024-11-14T06:30:29.768ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3872024-11-14T06:30:29.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3882024-11-14T06:30:29.772ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3892024-11-14T06:30:29.775ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
3902024-11-14T06:30:29.775ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3912024-11-14T06:30:29.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3922024-11-14T06:30:29.780ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 zone_address = fd00:1122:3344:101::2
3932024-11-14T06:30:29.780ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3942024-11-14T06:30:29.780ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e52df8ac-002f-4a54-b3f4-7641def996b2", "content-length": "26", "date": "Thu, 14 Nov 2024 06:30:29 GMT"} })
3952024-11-14T06:30:29.780ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
3962024-11-14T06:30:29.782ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
3972024-11-14T06:30:29.794ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T06:19:27.309503Z, time_modified: 2024-11-14T06:19:27.309503Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, db_silo: Silo { identity: SiloIdentity { id: 95153e51-68aa-4bd4-8e65-b8164172811d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T06:19:31.569300Z, time_modified: 2024-11-14T06:19:31.569300Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, db_silo: Silo { identity: SiloIdentity { id: 95153e51-68aa-4bd4-8e65-b8164172811d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T06:19:31.569300Z, time_modified: 2024-11-14T06:19:31.569300Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89" }] }) }
3982024-11-14T06:30:29.794ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 220.548505ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"95153e51-68aa-4bd4-8e65-b8164172811d","tls_certs":["3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89"]}},"default_endpoint":{"silo_id":"95153e51-68aa-4bd4-8e65-b8164172811d","tls_certs":["3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
3992024-11-14T06:30:29.822ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
4002024-11-14T06:30:29.822ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 247.823723ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
4012024-11-14T06:30:29.878ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
4022024-11-14T06:30:29.879ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
4032024-11-14T06:30:29.879ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "daf5b84f-08ca-4f23-bdf3-461324955a94", "content-length": "26", "date": "Thu, 14 Nov 2024 06:30:29 GMT"} })
4042024-11-14T06:30:29.879ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4052024-11-14T06:30:29.882ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
4062024-11-14T06:30:29.883ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
4072024-11-14T06:30:29.883ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
4082024-11-14T06:30:29.884ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "169e2b19-17f6-49b3-9a77-3830f99648f1", "content-length": "26", "date": "Thu, 14 Nov 2024 06:30:29 GMT"} })
4092024-11-14T06:30:29.884ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4102024-11-14T06:30:29.886ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
4112024-11-14T06:30:29.907ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
4122024-11-14T06:30:29.937ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
4132024-11-14T06:30:29.937ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
4142024-11-14T06:30:29.938ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
4152024-11-14T06:30:29.939ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "1bdb4adf-da23-4a34-87b6-4980efa9ebf7", "date": "Thu, 14 Nov 2024 06:30:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
4162024-11-14T06:30:29.939ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
4172024-11-14T06:30:29.940ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = c6d59938-b455-4e7b-9d17-0d6427a65b9c dns_zone_name = oxide.test found_so_far = 1 version = 2
4182024-11-14T06:30:29.940ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
4192024-11-14T06:30:29.940ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-14 06:19:31.616543 UTC dns_group = external generation = 2
4202024-11-14T06:30:29.940ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 366.217996ms iteration = 12 status = {"generation":2}
4212024-11-14T06:30:29.941ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "4130be8a-471e-456c-af30-f6d21cb178e3", "date": "Thu, 14 Nov 2024 06:30:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
4222024-11-14T06:30:29.941ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
4232024-11-14T06:30:29.943ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
4242024-11-14T06:30:29.943ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 369.305054ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
4252024-11-14T06:30:29.992ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d1d08948-d1d3-4417-b0ca-69899f5fa93d", "content-length": "372", "date": "Thu, 14 Nov 2024 06:30:29 GMT"} })
4262024-11-14T06:30:29.992ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4272024-11-14T06:30:29.992ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = b5592f39-55c5-410b-95c8-26c5799badf4 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
4282024-11-14T06:30:29.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4292024-11-14T06:30:29.993ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = b5592f39-55c5-410b-95c8-26c5799badf4 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
4302024-11-14T06:30:29.996ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3711 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = b5592f39-55c5-410b-95c8-26c5799badf4 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
4312024-11-14T06:30:30.016ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
4322024-11-14T06:30:30.016ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b83930d-780e-423a-b735-f67b921aa50e", "content-length": "1", "date": "Thu, 14 Nov 2024 06:30:29 GMT"} })
4332024-11-14T06:30:30.019ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4342024-11-14T06:30:30.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4352024-11-14T06:30:30.020ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 446.253367ms iteration = 23 status = {}
4362024-11-14T06:30:30.022ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 448.153952ms iteration = 23 status = null
4372024-11-14T06:30:30.026ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
4382024-11-14T06:30:30.026ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "5523ce5b-e99e-4fca-93da-cbd28b70b61b", "date": "Thu, 14 Nov 2024 06:30:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
4392024-11-14T06:30:30.026ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
4402024-11-14T06:30:30.029ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "3557a3b0-450f-45e7-b986-fd21dc4211d8", "date": "Thu, 14 Nov 2024 06:30:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
4412024-11-14T06:30:30.029ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
4422024-11-14T06:30:30.031ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "8da17909-b96e-4feb-b5f4-77161b504def", "date": "Thu, 14 Nov 2024 06:30:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
4432024-11-14T06:30:30.031ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
4442024-11-14T06:30:30.031ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4452024-11-14T06:30:30.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4462024-11-14T06:30:30.032ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4472024-11-14T06:30:30.033ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
4482024-11-14T06:30:30.033ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 459.101725ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
4492024-11-14T06:30:30.034ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
4502024-11-14T06:30:30.034ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4512024-11-14T06:30:30.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4522024-11-14T06:30:30.036ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4532024-11-14T06:30:30.037ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
4542024-11-14T06:30:30.037ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4552024-11-14T06:30:30.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4562024-11-14T06:30:30.038ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
4572024-11-14T06:30:30.038ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
4582024-11-14T06:30:30.039ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "60c0b30a-28cd-4064-b662-804a4626b2fb", "date": "Thu, 14 Nov 2024 06:30:29 GMT"} })
4592024-11-14T06:30:30.039ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4602024-11-14T06:30:30.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4612024-11-14T06:30:30.041ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4622024-11-14T06:30:30.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4632024-11-14T06:30:30.044ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4642024-11-14T06:30:30.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4652024-11-14T06:30:30.090ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4662024-11-14T06:30:30.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4672024-11-14T06:30:30.095ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
4682024-11-14T06:30:30.097ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: cecfafa4-4697-4aa6-949f-23c34aa9d5bd, rack_id: f391bffc-9f2b-4c87-85cd-2718afa7cb93, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(58c91208-be0a-4936-a7c2-2ae07694e16d) } rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
4692024-11-14T06:30:30.097ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4702024-11-14T06:30:30.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4712024-11-14T06:30:30.099ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
4722024-11-14T06:30:30.099ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
4732024-11-14T06:30:30.107ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
4742024-11-14T06:30:30.107ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "9019f00f-7ce0-4f23-b4a2-52d32313dcdb", "content-length": "134", "date": "Thu, 14 Nov 2024 06:30:29 GMT"} })
4752024-11-14T06:30:30.107ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
4762024-11-14T06:30:30.107ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 58c91208-be0a-4936-a7c2-2ae07694e16d
4772024-11-14T06:30:30.107ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
4782024-11-14T06:30:30.107ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
4792024-11-14T06:30:30.107ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4802024-11-14T06:30:30.107ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4812024-11-14T06:30:30.107ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4822024-11-14T06:30:30.108ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
4832024-11-14T06:30:30.108ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4842024-11-14T06:30:30.108ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
4852024-11-14T06:30:30.108ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
4862024-11-14T06:30:30.108ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4872024-11-14T06:30:30.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4882024-11-14T06:30:30.110ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
4892024-11-14T06:30:30.110ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "586aa6fb-f42d-48d9-9d7a-dd330cb02181", "content-length": "2", "date": "Thu, 14 Nov 2024 06:30:29 GMT"} })
4902024-11-14T06:30:30.110ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
4912024-11-14T06:30:30.110ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "0f3b39dd-e924-4c60-9daa-4c516871cb4b", "content-length": "52", "date": "Thu, 14 Nov 2024 06:30:29 GMT"} })
4922024-11-14T06:30:30.110ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
4932024-11-14T06:30:30.110ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
4942024-11-14T06:30:30.148ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "56d36556-ef8b-4ea8-a0ad-80c6c2a3f0ce", "date": "Thu, 14 Nov 2024 06:30:29 GMT"} })
4952024-11-14T06:30:30.150ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 575.39189ms iteration = 23 status = {}
4962024-11-14T06:30:30.150ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5af87d42-adbf-4f60-82d5-db904d4c7950", "content-length": "691", "date": "Thu, 14 Nov 2024 06:30:30 GMT"} })
4972024-11-14T06:30:30.150ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
4982024-11-14T06:30:30.150ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
4992024-11-14T06:30:30.150ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
5002024-11-14T06:30:30.152ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 578.204153ms iteration = 23 status = {}
5012024-11-14T06:30:30.248ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e0f5ed43-03a6-491c-91df-e482ad2d0ade", "date": "Thu, 14 Nov 2024 06:30:30 GMT"} })
5022024-11-14T06:30:30.248ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch = Switch0
5032024-11-14T06:30:30.248ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
5042024-11-14T06:30:30.248ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "962ca0ac-1d74-42d2-9fd1-f933b82a1475", "content-length": "682", "date": "Thu, 14 Nov 2024 06:30:30 GMT"} })
5052024-11-14T06:30:30.248ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5062024-11-14T06:30:30.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5072024-11-14T06:30:30.252ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5082024-11-14T06:30:30.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5092024-11-14T06:30:30.256ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5102024-11-14T06:30:30.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5112024-11-14T06:30:30.258ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5122024-11-14T06:30:30.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5132024-11-14T06:30:30.265ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 691.516322ms iteration = 23 status = {}
5142024-11-14T06:30:30.373ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
5152024-11-14T06:30:30.373ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
5162024-11-14T06:30:30.404ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
5172024-11-14T06:30:30.404ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:39718
5182024-11-14T06:30:30.404ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:39718 req_id = 2ab3b71c-487c-401d-bac5-e688a1f7b759 roles = RoleSet { roles: {} } uri = /metrics/producers
5192024-11-14T06:30:30.404ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:39718 req_id = 2ab3b71c-487c-401d-bac5-e688a1f7b759 resource = Database result = Ok(()) uri = /metrics/producers
5202024-11-14T06:30:30.443ZINFOnexus: assigned collector to new producer collector_id = d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6 file = nexus/src/app/oximeter.rs:76 producer_id = 80190dc3-d884-49a0-b9a3-38d31e8c655a
5212024-11-14T06:30:30.443ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39536 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:39718 req_id = 2ab3b71c-487c-401d-bac5-e688a1f7b759 response_code = 201 uri = /metrics/producers
5222024-11-14T06:30:30.443ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "2ab3b71c-487c-401d-bac5-e688a1f7b759", "content-length": "41", "date": "Thu, 14 Nov 2024 06:30:30 GMT"} })
5232024-11-14T06:30:30.446ZDEBGnexus (producer-registration-task): registered with nexus successfully
5242024-11-14T06:30:30.446ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
5252024-11-14T06:30:30.770ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36021 req_id = 178540e8-470f-40a6-951b-94492897581c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
5262024-11-14T06:30:30.770ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36021 req_id = 178540e8-470f-40a6-951b-94492897581c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
5272024-11-14T06:30:30.775ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5471 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36021 req_id = 178540e8-470f-40a6-951b-94492897581c response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
5282024-11-14T06:30:31.017ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 49a5c2e5-7015-4f40-b469-1e11a131a859 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
5292024-11-14T06:30:31.018ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 49a5c2e5-7015-4f40-b469-1e11a131a859 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
5302024-11-14T06:30:31.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2388 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 49a5c2e5-7015-4f40-b469-1e11a131a859 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
5312024-11-14T06:30:32.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 4cc7a3ec-2dcc-4ecb-b0bf-10a212b158ed roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
5322024-11-14T06:30:32.041ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 4cc7a3ec-2dcc-4ecb-b0bf-10a212b158ed resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
5332024-11-14T06:30:32.043ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2503 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 4cc7a3ec-2dcc-4ecb-b0bf-10a212b158ed response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
5342024-11-14T06:30:33.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f2cad8d7-3a6e-46c4-8457-6df5aae66ea7 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
5352024-11-14T06:30:33.065ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f2cad8d7-3a6e-46c4-8457-6df5aae66ea7 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
5362024-11-14T06:30:33.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2144 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f2cad8d7-3a6e-46c4-8457-6df5aae66ea7 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
5372024-11-14T06:30:34.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = b7c504da-d8af-4192-8549-42e2fd544db5 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
5382024-11-14T06:30:34.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = b7c504da-d8af-4192-8549-42e2fd544db5 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
5392024-11-14T06:30:34.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2491 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = b7c504da-d8af-4192-8549-42e2fd544db5 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
5402024-11-14T06:30:35.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 2690cae3-ac69-4d37-bb82-3f6567f854f1 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
5412024-11-14T06:30:35.110ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 2690cae3-ac69-4d37-bb82-3f6567f854f1 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
5422024-11-14T06:30:35.112ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2534 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 2690cae3-ac69-4d37-bb82-3f6567f854f1 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
5432024-11-14T06:30:36.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 200e3fa7-4841-46f8-91d8-69a83d7cb2ef roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
5442024-11-14T06:30:36.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 200e3fa7-4841-46f8-91d8-69a83d7cb2ef resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
5452024-11-14T06:30:36.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2626 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 200e3fa7-4841-46f8-91d8-69a83d7cb2ef response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
5462024-11-14T06:30:37.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 2600740b-5daa-4894-bdd9-156c1ccfe93b roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
5472024-11-14T06:30:37.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 2600740b-5daa-4894-bdd9-156c1ccfe93b resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
5482024-11-14T06:30:37.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1817 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 2600740b-5daa-4894-bdd9-156c1ccfe93b response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
5492024-11-14T06:30:37.605ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 571 local_addr = [fd00:1122:3344:101::c]:60882 method = GET remote_addr = [fd00:1122:3344:101::d]:64488 req_id = 3bfe0c9c-6583-41fa-8a68-13e81cd9a1e5 response_code = 200 uri = /80190dc3-d884-49a0-b9a3-38d31e8c655a
5502024-11-14T06:30:38.180ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = e997e873-14a1-41e5-9077-665621e76811 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
5512024-11-14T06:30:38.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = e997e873-14a1-41e5-9077-665621e76811 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
5522024-11-14T06:30:38.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2049 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = e997e873-14a1-41e5-9077-665621e76811 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
5532024-11-14T06:30:39.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = e4826419-9f3b-44d5-aa09-a4892c0dfdf0 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
5542024-11-14T06:30:39.203ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = e4826419-9f3b-44d5-aa09-a4892c0dfdf0 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
5552024-11-14T06:30:39.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2151 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = e4826419-9f3b-44d5-aa09-a4892c0dfdf0 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
5562024-11-14T06:30:39.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
5572024-11-14T06:30:39.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
5582024-11-14T06:30:39.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5592024-11-14T06:30:39.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5602024-11-14T06:30:39.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5612024-11-14T06:30:39.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5622024-11-14T06:30:39.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5632024-11-14T06:30:39.578ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5642024-11-14T06:30:39.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5652024-11-14T06:30:39.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5662024-11-14T06:30:39.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5672024-11-14T06:30:39.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5682024-11-14T06:30:39.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5692024-11-14T06:30:39.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
5702024-11-14T06:30:39.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5712024-11-14T06:30:39.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5722024-11-14T06:30:39.596ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
5732024-11-14T06:30:39.596ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.118471ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
5742024-11-14T06:30:39.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5752024-11-14T06:30:39.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5762024-11-14T06:30:39.630ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.963662ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
5772024-11-14T06:30:40.225ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = aaad27d4-b83c-43e7-9a48-d23ae6084dac roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
5782024-11-14T06:30:40.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = aaad27d4-b83c-43e7-9a48-d23ae6084dac resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
5792024-11-14T06:30:40.228ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2519 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = aaad27d4-b83c-43e7-9a48-d23ae6084dac response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
5802024-11-14T06:30:41.248ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 29294cf8-c09e-4cf4-a472-19ddef3f35c8 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
5812024-11-14T06:30:41.248ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 29294cf8-c09e-4cf4-a472-19ddef3f35c8 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
5822024-11-14T06:30:41.250ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2384 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 29294cf8-c09e-4cf4-a472-19ddef3f35c8 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
5832024-11-14T06:30:42.272ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 9c9bfc39-6382-41ad-9139-ae5e16a7c28e roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
5842024-11-14T06:30:42.273ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 9c9bfc39-6382-41ad-9139-ae5e16a7c28e resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
5852024-11-14T06:30:42.274ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2436 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 9c9bfc39-6382-41ad-9139-ae5e16a7c28e response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
5862024-11-14T06:30:43.297ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = eb0ca370-2765-4bdf-9d48-da8a4aeb1e2b roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
5872024-11-14T06:30:43.297ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = eb0ca370-2765-4bdf-9d48-da8a4aeb1e2b resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
5882024-11-14T06:30:43.299ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2299 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = eb0ca370-2765-4bdf-9d48-da8a4aeb1e2b response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
5892024-11-14T06:30:44.318ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 631477ba-e871-4bb5-828a-1b34677ae611 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
5902024-11-14T06:30:44.318ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 631477ba-e871-4bb5-828a-1b34677ae611 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
5912024-11-14T06:30:44.320ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1991 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 631477ba-e871-4bb5-828a-1b34677ae611 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
5922024-11-14T06:30:45.341ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = b5f08690-c274-4db8-9864-8065c9d48c4e roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
5932024-11-14T06:30:45.342ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = b5f08690-c274-4db8-9864-8065c9d48c4e resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
5942024-11-14T06:30:45.343ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1933 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = b5f08690-c274-4db8-9864-8065c9d48c4e response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
5952024-11-14T06:30:46.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 63cdec84-e618-49d0-9469-ffe74a945d17 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
5962024-11-14T06:30:46.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 63cdec84-e618-49d0-9469-ffe74a945d17 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
5972024-11-14T06:30:46.367ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1960 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 63cdec84-e618-49d0-9469-ffe74a945d17 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
5982024-11-14T06:30:47.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = a2cc8027-2e2b-4dec-a635-e0e168b2ce2f roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
5992024-11-14T06:30:47.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = a2cc8027-2e2b-4dec-a635-e0e168b2ce2f resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
6002024-11-14T06:30:47.390ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1894 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = a2cc8027-2e2b-4dec-a635-e0e168b2ce2f response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
6012024-11-14T06:30:48.411ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 78a57a4a-fe49-48d1-a1f6-3d3ba8a6e28a roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
6022024-11-14T06:30:48.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 78a57a4a-fe49-48d1-a1f6-3d3ba8a6e28a resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
6032024-11-14T06:30:48.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2404 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 78a57a4a-fe49-48d1-a1f6-3d3ba8a6e28a response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
6042024-11-14T06:30:49.433ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 20f85a43-0d3e-4b44-9a4c-d98d2fd13171 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
6052024-11-14T06:30:49.434ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 20f85a43-0d3e-4b44-9a4c-d98d2fd13171 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
6062024-11-14T06:30:49.435ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1717 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 20f85a43-0d3e-4b44-9a4c-d98d2fd13171 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
6072024-11-14T06:30:49.573ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
6082024-11-14T06:30:49.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
6092024-11-14T06:30:49.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6102024-11-14T06:30:49.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6112024-11-14T06:30:49.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6122024-11-14T06:30:49.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6132024-11-14T06:30:49.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6142024-11-14T06:30:49.578ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
6152024-11-14T06:30:49.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6162024-11-14T06:30:49.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6172024-11-14T06:30:49.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6182024-11-14T06:30:49.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6192024-11-14T06:30:49.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6202024-11-14T06:30:49.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
6212024-11-14T06:30:49.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6222024-11-14T06:30:49.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6232024-11-14T06:30:49.594ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
6242024-11-14T06:30:49.594ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.839578ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
6252024-11-14T06:30:49.600ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6262024-11-14T06:30:49.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6272024-11-14T06:30:49.602ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 28.604582ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6282024-11-14T06:30:50.457ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 3a51f687-2188-4489-8a5a-6900ff723c5f roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
6292024-11-14T06:30:50.457ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 3a51f687-2188-4489-8a5a-6900ff723c5f resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
6302024-11-14T06:30:50.459ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2214 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 3a51f687-2188-4489-8a5a-6900ff723c5f response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
6312024-11-14T06:30:51.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 9ae48649-d690-452e-8bde-4830cbca07bb roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
6322024-11-14T06:30:51.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 9ae48649-d690-452e-8bde-4830cbca07bb resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
6332024-11-14T06:30:51.482ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2477 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 9ae48649-d690-452e-8bde-4830cbca07bb response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
6342024-11-14T06:30:52.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 23b642fa-374c-4635-9125-c3e7d16ce617 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
6352024-11-14T06:30:52.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 23b642fa-374c-4635-9125-c3e7d16ce617 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
6362024-11-14T06:30:52.505ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2365 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 23b642fa-374c-4635-9125-c3e7d16ce617 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
6372024-11-14T06:30:52.607ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 570 local_addr = [fd00:1122:3344:101::c]:60882 method = GET remote_addr = [fd00:1122:3344:101::d]:64488 req_id = cbea1d49-0688-4651-bfcc-cb6f14952836 response_code = 200 uri = /80190dc3-d884-49a0-b9a3-38d31e8c655a
6382024-11-14T06:30:53.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = db91a9ee-6bd3-42fb-a764-4a4b3f864d92 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
6392024-11-14T06:30:53.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = db91a9ee-6bd3-42fb-a764-4a4b3f864d92 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
6402024-11-14T06:30:53.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1717 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = db91a9ee-6bd3-42fb-a764-4a4b3f864d92 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
6412024-11-14T06:30:54.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = a1e5c1e8-b050-407c-a57e-8a11c393e05b roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
6422024-11-14T06:30:54.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = a1e5c1e8-b050-407c-a57e-8a11c393e05b resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
6432024-11-14T06:30:54.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2486 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = a1e5c1e8-b050-407c-a57e-8a11c393e05b response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
6442024-11-14T06:30:55.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = d4a6ca86-3499-4b4b-8501-70106f4b8275 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
6452024-11-14T06:30:55.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = d4a6ca86-3499-4b4b-8501-70106f4b8275 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
6462024-11-14T06:30:55.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2838 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = d4a6ca86-3499-4b4b-8501-70106f4b8275 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
6472024-11-14T06:30:56.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = cadd1d08-fa82-4f09-9bc7-6697c4374e8f roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
6482024-11-14T06:30:56.592ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = cadd1d08-fa82-4f09-9bc7-6697c4374e8f resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
6492024-11-14T06:30:56.594ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2387 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = cadd1d08-fa82-4f09-9bc7-6697c4374e8f response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
6502024-11-14T06:30:57.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = b266913e-a947-4e4f-bfec-73d5c21d436c roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
6512024-11-14T06:30:57.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = b266913e-a947-4e4f-bfec-73d5c21d436c resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
6522024-11-14T06:30:57.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2003 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = b266913e-a947-4e4f-bfec-73d5c21d436c response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
6532024-11-14T06:30:58.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = cfb9742b-6280-4a14-bb71-e4ae8ab6ab1e roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
6542024-11-14T06:30:58.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = cfb9742b-6280-4a14-bb71-e4ae8ab6ab1e resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
6552024-11-14T06:30:58.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2302 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = cfb9742b-6280-4a14-bb71-e4ae8ab6ab1e response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
6562024-11-14T06:30:59.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
6572024-11-14T06:30:59.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6582024-11-14T06:30:59.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
6592024-11-14T06:30:59.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
6602024-11-14T06:30:59.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6612024-11-14T06:30:59.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
6622024-11-14T06:30:59.574ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
6632024-11-14T06:30:59.574ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
6642024-11-14T06:30:59.574ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6652024-11-14T06:30:59.574ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
6662024-11-14T06:30:59.574ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
6672024-11-14T06:30:59.574ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
6682024-11-14T06:30:59.574ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
6692024-11-14T06:30:59.574ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6702024-11-14T06:30:59.574ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
6712024-11-14T06:30:59.574ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
6722024-11-14T06:30:59.574ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6732024-11-14T06:30:59.574ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
6742024-11-14T06:30:59.574ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
6752024-11-14T06:30:59.574ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6762024-11-14T06:30:59.574ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
6772024-11-14T06:30:59.574ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6782024-11-14T06:30:59.574ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
6792024-11-14T06:30:59.574ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
6802024-11-14T06:30:59.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6812024-11-14T06:30:59.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
6822024-11-14T06:30:59.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6832024-11-14T06:30:59.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6842024-11-14T06:30:59.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6852024-11-14T06:30:59.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
6862024-11-14T06:30:59.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6872024-11-14T06:30:59.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6882024-11-14T06:30:59.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
6892024-11-14T06:30:59.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6902024-11-14T06:30:59.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
6912024-11-14T06:30:59.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
6922024-11-14T06:30:59.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6932024-11-14T06:30:59.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
6942024-11-14T06:30:59.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
6952024-11-14T06:30:59.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
6962024-11-14T06:30:59.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
6972024-11-14T06:30:59.575ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
6982024-11-14T06:30:59.575ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
6992024-11-14T06:30:59.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
7002024-11-14T06:30:59.575ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7012024-11-14T06:30:59.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
7022024-11-14T06:30:59.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
7032024-11-14T06:30:59.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
7042024-11-14T06:30:59.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7052024-11-14T06:30:59.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
7062024-11-14T06:30:59.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
7072024-11-14T06:30:59.577ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7082024-11-14T06:30:59.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7092024-11-14T06:30:59.577ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.747771ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
7102024-11-14T06:30:59.578ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7112024-11-14T06:30:59.579ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7122024-11-14T06:30:59.579ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7132024-11-14T06:30:59.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
7142024-11-14T06:30:59.580ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7152024-11-14T06:30:59.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7162024-11-14T06:30:59.582ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
7172024-11-14T06:30:59.582ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7182024-11-14T06:30:59.582ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
7192024-11-14T06:30:59.582ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
7202024-11-14T06:30:59.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7212024-11-14T06:30:59.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
7222024-11-14T06:30:59.583ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1716, tv_nsec: 141535255 } })
7232024-11-14T06:30:59.583ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
7242024-11-14T06:30:59.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7252024-11-14T06:30:59.584ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7262024-11-14T06:30:59.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
7272024-11-14T06:30:59.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7282024-11-14T06:30:59.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
7292024-11-14T06:30:59.588ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7302024-11-14T06:30:59.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7312024-11-14T06:30:59.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7322024-11-14T06:30:59.589ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1716, tv_nsec: 147174180 } })
7332024-11-14T06:30:59.589ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
7342024-11-14T06:30:59.594ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 19.911071ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
7352024-11-14T06:30:59.601ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7362024-11-14T06:30:59.601ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1716, tv_nsec: 159384928 } })
7372024-11-14T06:30:59.601ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
7382024-11-14T06:30:59.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7392024-11-14T06:30:59.601ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7402024-11-14T06:30:59.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7412024-11-14T06:30:59.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7422024-11-14T06:30:59.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7432024-11-14T06:30:59.603ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7442024-11-14T06:30:59.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
7452024-11-14T06:30:59.606ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7462024-11-14T06:30:59.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7472024-11-14T06:30:59.624ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 48.636546ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
7482024-11-14T06:30:59.625ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7492024-11-14T06:30:59.625ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
7502024-11-14T06:30:59.625ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
7512024-11-14T06:30:59.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
7522024-11-14T06:30:59.634ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
7532024-11-14T06:30:59.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
7542024-11-14T06:30:59.636ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7552024-11-14T06:30:59.639ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
7562024-11-14T06:30:59.639ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7572024-11-14T06:30:59.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7582024-11-14T06:30:59.643ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 68.008326ms iteration = 24 status = {"errors":[],"records_set_to_done":[]}
7592024-11-14T06:30:59.644ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
7602024-11-14T06:30:59.644ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
7612024-11-14T06:30:59.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
7622024-11-14T06:30:59.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
7632024-11-14T06:30:59.645ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
7642024-11-14T06:30:59.645ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 70.549153ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
7652024-11-14T06:30:59.646ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7662024-11-14T06:30:59.649ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
7672024-11-14T06:30:59.649ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7682024-11-14T06:30:59.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7692024-11-14T06:30:59.649ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7702024-11-14T06:30:59.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7712024-11-14T06:30:59.652ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7722024-11-14T06:30:59.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7732024-11-14T06:30:59.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 4606179c-8de9-49ae-9d1b-7fc3edd96389 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
7742024-11-14T06:30:59.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 4606179c-8de9-49ae-9d1b-7fc3edd96389 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
7752024-11-14T06:30:59.663ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
7762024-11-14T06:30:59.663ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 88.768562ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
7772024-11-14T06:30:59.663ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2390 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 4606179c-8de9-49ae-9d1b-7fc3edd96389 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
7782024-11-14T06:30:59.671ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7792024-11-14T06:30:59.671ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
7802024-11-14T06:30:59.671ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
7812024-11-14T06:30:59.671ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
7822024-11-14T06:30:59.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
7832024-11-14T06:30:59.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
7842024-11-14T06:30:59.672ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
7852024-11-14T06:30:59.672ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7862024-11-14T06:30:59.672ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
7872024-11-14T06:30:59.672ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7882024-11-14T06:30:59.673ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b14f3fd-8cbe-4a96-b204-4e8a09508697", "content-length": "26", "date": "Thu, 14 Nov 2024 06:30:59 GMT"} })
7892024-11-14T06:30:59.673ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7902024-11-14T06:30:59.673ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ee86522-09ab-40ee-9046-804a7c07c576", "content-length": "26", "date": "Thu, 14 Nov 2024 06:30:59 GMT"} })
7912024-11-14T06:30:59.673ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7922024-11-14T06:30:59.678ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
7932024-11-14T06:30:59.678ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
7942024-11-14T06:30:59.680ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 105.117947ms iteration = 24 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
7952024-11-14T06:30:59.686ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 112.390322ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
7962024-11-14T06:30:59.690ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7972024-11-14T06:30:59.692ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7982024-11-14T06:30:59.694ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 27a56cb4-44ff-4d5b-931e-1c2c0642844d, lookup_type: ById(27a56cb4-44ff-4d5b-931e-1c2c0642844d) } result = Ok(())
7992024-11-14T06:30:59.694ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8002024-11-14T06:30:59.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8012024-11-14T06:30:59.694ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
8022024-11-14T06:30:59.694ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8032024-11-14T06:30:59.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8042024-11-14T06:30:59.696ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 121.931969ms iteration = 24 status = 0
8052024-11-14T06:30:59.705ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 zone_address = fd00:1122:3344:101::2
8062024-11-14T06:30:59.705ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
8072024-11-14T06:30:59.706ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e8886f0d-0f1b-43e0-b735-1a90b50fa790", "content-length": "26", "date": "Thu, 14 Nov 2024 06:30:59 GMT"} })
8082024-11-14T06:30:59.706ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
8092024-11-14T06:30:59.708ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
8102024-11-14T06:30:59.713ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 138.276643ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
8112024-11-14T06:30:59.715ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
8122024-11-14T06:30:59.715ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
8132024-11-14T06:30:59.715ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 140.73012ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
8142024-11-14T06:30:59.725ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8152024-11-14T06:30:59.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8162024-11-14T06:30:59.726ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 152.045881ms iteration = 27 status = {"physical_disks_added":0}
8172024-11-14T06:30:59.786ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 211.751621ms iteration = 24 status = {}
8182024-11-14T06:30:59.795ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
8192024-11-14T06:30:59.795ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "828fe687-95c0-463c-8538-e435675523d0", "content-length": "1", "date": "Thu, 14 Nov 2024 06:30:59 GMT"} })
8202024-11-14T06:30:59.798ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
8212024-11-14T06:30:59.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
8222024-11-14T06:30:59.800ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 226.029718ms iteration = 24 status = null
8232024-11-14T06:30:59.833ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8242024-11-14T06:30:59.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8252024-11-14T06:30:59.846ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
8262024-11-14T06:30:59.846ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
8272024-11-14T06:30:59.861ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8282024-11-14T06:30:59.863ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8292024-11-14T06:30:59.863ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8302024-11-14T06:30:59.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8312024-11-14T06:30:59.893ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8322024-11-14T06:30:59.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8332024-11-14T06:30:59.893ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8342024-11-14T06:30:59.895ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: cecfafa4-4697-4aa6-949f-23c34aa9d5bd, rack_id: f391bffc-9f2b-4c87-85cd-2718afa7cb93, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(58c91208-be0a-4936-a7c2-2ae07694e16d) } rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
8352024-11-14T06:30:59.895ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8362024-11-14T06:30:59.895ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8372024-11-14T06:30:59.895ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8382024-11-14T06:30:59.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8392024-11-14T06:30:59.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8402024-11-14T06:30:59.905ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "29a67b6e-e39e-4615-8478-82f5ef5d38f0", "content-length": "372", "date": "Thu, 14 Nov 2024 06:30:59 GMT"} })
8412024-11-14T06:30:59.905ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8422024-11-14T06:30:59.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8432024-11-14T06:30:59.907ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
8442024-11-14T06:30:59.907ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "24a1a24a-8fd1-425f-93d4-0da36c7258f3", "content-length": "134", "date": "Thu, 14 Nov 2024 06:30:59 GMT"} })
8452024-11-14T06:30:59.907ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
8462024-11-14T06:30:59.907ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 58c91208-be0a-4936-a7c2-2ae07694e16d
8472024-11-14T06:30:59.907ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
8482024-11-14T06:30:59.907ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
8492024-11-14T06:30:59.907ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8502024-11-14T06:30:59.907ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8512024-11-14T06:30:59.907ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8522024-11-14T06:30:59.907ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
8532024-11-14T06:30:59.908ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8542024-11-14T06:30:59.908ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
8552024-11-14T06:30:59.908ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
8562024-11-14T06:30:59.908ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8572024-11-14T06:30:59.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8582024-11-14T06:30:59.910ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
8592024-11-14T06:30:59.910ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "f5060c8e-d41e-419c-9076-2a3e986b6f96", "content-length": "2", "date": "Thu, 14 Nov 2024 06:30:59 GMT"} })
8602024-11-14T06:30:59.910ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
8612024-11-14T06:30:59.910ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7588c0a-8726-4d46-8c53-5f561a8c3f99", "content-length": "52", "date": "Thu, 14 Nov 2024 06:30:59 GMT"} })
8622024-11-14T06:30:59.910ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
8632024-11-14T06:30:59.910ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
8642024-11-14T06:30:59.966ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
8652024-11-14T06:30:59.966ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
8662024-11-14T06:30:59.967ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7dc210cc-63af-4c92-9bdf-09a44b9dba57", "date": "Thu, 14 Nov 2024 06:30:59 GMT"} })
8672024-11-14T06:30:59.967ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8682024-11-14T06:30:59.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8692024-11-14T06:30:59.970ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8702024-11-14T06:30:59.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8712024-11-14T06:30:59.992ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
8722024-11-14T06:30:59.992ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "cda01c4f-60c1-44fe-822f-d28821552121", "content-length": "691", "date": "Thu, 14 Nov 2024 06:30:59 GMT"} })
8732024-11-14T06:30:59.992ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
8742024-11-14T06:30:59.992ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
8752024-11-14T06:30:59.992ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
8762024-11-14T06:30:59.995ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 420.549468ms iteration = 24 status = {}
8772024-11-14T06:30:59.995ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8782024-11-14T06:30:59.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8792024-11-14T06:31:00.000ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
8802024-11-14T06:31:00.000ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
8812024-11-14T06:31:00.002ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "cf38ce6e-a86a-468b-82a0-73d99b4ac262", "date": "Thu, 14 Nov 2024 06:30:59 GMT"} })
8822024-11-14T06:31:00.003ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 428.2038ms iteration = 24 status = {}
8832024-11-14T06:31:00.105ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "1eafcd0e-2bb1-475e-a666-51c6b403c84c", "date": "Thu, 14 Nov 2024 06:30:59 GMT"} })
8842024-11-14T06:31:00.105ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch = Switch0
8852024-11-14T06:31:00.105ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
8862024-11-14T06:31:00.106ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "4a4e6450-1c41-4a8a-a80c-10a74c047a11", "content-length": "682", "date": "Thu, 14 Nov 2024 06:30:59 GMT"} })
8872024-11-14T06:31:00.106ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8882024-11-14T06:31:00.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8892024-11-14T06:31:00.109ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8902024-11-14T06:31:00.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8912024-11-14T06:31:00.113ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8922024-11-14T06:31:00.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8932024-11-14T06:31:00.115ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8942024-11-14T06:31:00.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8952024-11-14T06:31:00.122ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 547.95435ms iteration = 24 status = {}
8962024-11-14T06:31:00.691ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = cad193b1-c56b-44f8-a5d3-fc74aa4be5de roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
8972024-11-14T06:31:00.691ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = cad193b1-c56b-44f8-a5d3-fc74aa4be5de resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
8982024-11-14T06:31:00.693ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2345 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = cad193b1-c56b-44f8-a5d3-fc74aa4be5de response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
8992024-11-14T06:31:00.806ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36021 req_id = 4bb854af-3842-405e-a209-b576eea744ce roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
9002024-11-14T06:31:00.806ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36021 req_id = 4bb854af-3842-405e-a209-b576eea744ce resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
9012024-11-14T06:31:00.809ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2997 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36021 req_id = 4bb854af-3842-405e-a209-b576eea744ce response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
9022024-11-14T06:31:01.716ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = eb6c6ba7-8e2a-47b2-b74a-7f3562f5e5ad roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
9032024-11-14T06:31:01.716ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = eb6c6ba7-8e2a-47b2-b74a-7f3562f5e5ad resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
9042024-11-14T06:31:01.718ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2121 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = eb6c6ba7-8e2a-47b2-b74a-7f3562f5e5ad response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
9052024-11-14T06:31:02.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 1202fd22-1e25-48e6-beed-d839f741181c roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
9062024-11-14T06:31:02.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 1202fd22-1e25-48e6-beed-d839f741181c resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
9072024-11-14T06:31:02.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2191 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 1202fd22-1e25-48e6-beed-d839f741181c response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
9082024-11-14T06:31:03.763ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 4466be00-6f68-493a-abcd-9fdd1561dfd3 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
9092024-11-14T06:31:03.763ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 4466be00-6f68-493a-abcd-9fdd1561dfd3 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
9102024-11-14T06:31:03.766ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2967 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 4466be00-6f68-493a-abcd-9fdd1561dfd3 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
9112024-11-14T06:31:04.786ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 917ebeb2-e998-46c2-8d2c-4af21feb8db0 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
9122024-11-14T06:31:04.787ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 917ebeb2-e998-46c2-8d2c-4af21feb8db0 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
9132024-11-14T06:31:04.788ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2332 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 917ebeb2-e998-46c2-8d2c-4af21feb8db0 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
9142024-11-14T06:31:05.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 7a5ecc32-1ccb-4fec-9ed0-59ac86c0229f roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
9152024-11-14T06:31:05.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 7a5ecc32-1ccb-4fec-9ed0-59ac86c0229f resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
9162024-11-14T06:31:05.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2784 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 7a5ecc32-1ccb-4fec-9ed0-59ac86c0229f response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
9172024-11-14T06:31:06.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 9f27e2a5-20f1-4e28-904d-9166feaec060 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
9182024-11-14T06:31:06.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 9f27e2a5-20f1-4e28-904d-9166feaec060 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
9192024-11-14T06:31:06.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1568 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 9f27e2a5-20f1-4e28-904d-9166feaec060 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
9202024-11-14T06:31:07.605ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 977 local_addr = [fd00:1122:3344:101::c]:60882 method = GET remote_addr = [fd00:1122:3344:101::d]:64488 req_id = d76efc8a-fc7d-4e5f-865c-4a5bb3824b2d response_code = 200 uri = /80190dc3-d884-49a0-b9a3-38d31e8c655a
9212024-11-14T06:31:07.853ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 5013cd18-8cfe-42a4-82ee-b66b40ee7e19 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
9222024-11-14T06:31:07.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 5013cd18-8cfe-42a4-82ee-b66b40ee7e19 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
9232024-11-14T06:31:07.858ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4309 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 5013cd18-8cfe-42a4-82ee-b66b40ee7e19 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
9242024-11-14T06:31:08.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 2ff29afd-274e-400d-a342-1e6481bd098b roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
9252024-11-14T06:31:08.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 2ff29afd-274e-400d-a342-1e6481bd098b resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
9262024-11-14T06:31:08.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2820 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 2ff29afd-274e-400d-a342-1e6481bd098b response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
9272024-11-14T06:31:09.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
9282024-11-14T06:31:09.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
9292024-11-14T06:31:09.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9302024-11-14T06:31:09.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9312024-11-14T06:31:09.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9322024-11-14T06:31:09.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9332024-11-14T06:31:09.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9342024-11-14T06:31:09.604ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9352024-11-14T06:31:09.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9362024-11-14T06:31:09.605ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9372024-11-14T06:31:09.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9382024-11-14T06:31:09.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9392024-11-14T06:31:09.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9402024-11-14T06:31:09.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9412024-11-14T06:31:09.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9422024-11-14T06:31:09.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
9432024-11-14T06:31:09.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9442024-11-14T06:31:09.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9452024-11-14T06:31:09.626ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
9462024-11-14T06:31:09.626ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 52.514048ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
9472024-11-14T06:31:09.638ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.640433ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9482024-11-14T06:31:09.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 164fb7b4-26f0-4873-858d-11e95b5d1189 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
9492024-11-14T06:31:09.903ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 164fb7b4-26f0-4873-858d-11e95b5d1189 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
9502024-11-14T06:31:09.905ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2528 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 164fb7b4-26f0-4873-858d-11e95b5d1189 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
9512024-11-14T06:31:10.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 6cb55a69-19eb-40e0-a919-c48fb1c04dd8 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
9522024-11-14T06:31:10.924ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 6cb55a69-19eb-40e0-a919-c48fb1c04dd8 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
9532024-11-14T06:31:10.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1798 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 6cb55a69-19eb-40e0-a919-c48fb1c04dd8 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
9542024-11-14T06:31:11.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = bd0dc69d-64c6-4dcd-8488-6195e866efe1 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
9552024-11-14T06:31:11.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = bd0dc69d-64c6-4dcd-8488-6195e866efe1 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
9562024-11-14T06:31:11.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2566 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = bd0dc69d-64c6-4dcd-8488-6195e866efe1 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
9572024-11-14T06:31:12.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = bd7e25cc-dbde-44fa-96b8-213d1e20e753 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
9582024-11-14T06:31:12.972ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = bd7e25cc-dbde-44fa-96b8-213d1e20e753 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
9592024-11-14T06:31:12.974ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2134 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = bd7e25cc-dbde-44fa-96b8-213d1e20e753 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
9602024-11-14T06:31:13.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 2796aacd-0004-475b-b607-c9a3f75f2f5f roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
9612024-11-14T06:31:13.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 2796aacd-0004-475b-b607-c9a3f75f2f5f resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
9622024-11-14T06:31:13.996ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2125 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 2796aacd-0004-475b-b607-c9a3f75f2f5f response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
9632024-11-14T06:31:15.017ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 0a8c8d97-9e49-4cda-8a01-8e1ef87687d9 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
9642024-11-14T06:31:15.017ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 0a8c8d97-9e49-4cda-8a01-8e1ef87687d9 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
9652024-11-14T06:31:15.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2654 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 0a8c8d97-9e49-4cda-8a01-8e1ef87687d9 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
9662024-11-14T06:31:16.042ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f8fb719d-4589-4945-8d18-060bc1beea72 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
9672024-11-14T06:31:16.042ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f8fb719d-4589-4945-8d18-060bc1beea72 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
9682024-11-14T06:31:16.043ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1715 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f8fb719d-4589-4945-8d18-060bc1beea72 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
9692024-11-14T06:31:17.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = fe495f41-4706-41ec-8f20-354e2e66d4ed roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
9702024-11-14T06:31:17.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = fe495f41-4706-41ec-8f20-354e2e66d4ed resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
9712024-11-14T06:31:17.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2254 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = fe495f41-4706-41ec-8f20-354e2e66d4ed response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
9722024-11-14T06:31:18.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 2895b37b-f210-46ae-988f-074cbf416335 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
9732024-11-14T06:31:18.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 2895b37b-f210-46ae-988f-074cbf416335 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
9742024-11-14T06:31:18.089ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1965 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 2895b37b-f210-46ae-988f-074cbf416335 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
9752024-11-14T06:31:19.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 5dd5161a-fea2-4c1f-abdc-cdd0acd305f5 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
9762024-11-14T06:31:19.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 5dd5161a-fea2-4c1f-abdc-cdd0acd305f5 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
9772024-11-14T06:31:19.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2593 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 5dd5161a-fea2-4c1f-abdc-cdd0acd305f5 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
9782024-11-14T06:31:19.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
9792024-11-14T06:31:19.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
9802024-11-14T06:31:19.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9812024-11-14T06:31:19.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9822024-11-14T06:31:19.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9832024-11-14T06:31:19.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9842024-11-14T06:31:19.576ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9852024-11-14T06:31:19.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9862024-11-14T06:31:19.606ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.062027ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9872024-11-14T06:31:19.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9882024-11-14T06:31:19.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9892024-11-14T06:31:19.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9902024-11-14T06:31:19.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9912024-11-14T06:31:19.616ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9922024-11-14T06:31:19.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9932024-11-14T06:31:19.617ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9942024-11-14T06:31:19.620ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
9952024-11-14T06:31:19.620ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9962024-11-14T06:31:19.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9972024-11-14T06:31:19.632ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
9982024-11-14T06:31:19.632ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 58.193353ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
9992024-11-14T06:31:20.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = a90c7db8-653b-473a-848d-e9b56e2c583e roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
10002024-11-14T06:31:20.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = a90c7db8-653b-473a-848d-e9b56e2c583e resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
10012024-11-14T06:31:20.135ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2027 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = a90c7db8-653b-473a-848d-e9b56e2c583e response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
10022024-11-14T06:31:21.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = dd8bec84-dac1-4ea5-b422-0c64d0ef66f5 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
10032024-11-14T06:31:21.155ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = dd8bec84-dac1-4ea5-b422-0c64d0ef66f5 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
10042024-11-14T06:31:21.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2454 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = dd8bec84-dac1-4ea5-b422-0c64d0ef66f5 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
10052024-11-14T06:31:22.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = bda36491-6825-4b99-b9d6-d6371782a801 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
10062024-11-14T06:31:22.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = bda36491-6825-4b99-b9d6-d6371782a801 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
10072024-11-14T06:31:22.181ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1992 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = bda36491-6825-4b99-b9d6-d6371782a801 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
10082024-11-14T06:31:22.606ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 523 local_addr = [fd00:1122:3344:101::c]:60882 method = GET remote_addr = [fd00:1122:3344:101::d]:64488 req_id = 716ca995-777c-4b2a-8829-1cd22b1d4ae7 response_code = 200 uri = /80190dc3-d884-49a0-b9a3-38d31e8c655a
10092024-11-14T06:31:23.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 081e7515-7230-46de-8844-ddca882ad8a2 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
10102024-11-14T06:31:23.203ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 081e7515-7230-46de-8844-ddca882ad8a2 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
10112024-11-14T06:31:23.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1949 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 081e7515-7230-46de-8844-ddca882ad8a2 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
10122024-11-14T06:31:24.225ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = d88db7b3-7ca8-4169-b59b-5bb54ffb4d7b roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
10132024-11-14T06:31:24.225ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = d88db7b3-7ca8-4169-b59b-5bb54ffb4d7b resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
10142024-11-14T06:31:24.227ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2459 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = d88db7b3-7ca8-4169-b59b-5bb54ffb4d7b response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
10152024-11-14T06:31:25.247ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = b4a4b551-8594-4aab-bfc4-49faf7961813 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
10162024-11-14T06:31:25.248ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = b4a4b551-8594-4aab-bfc4-49faf7961813 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
10172024-11-14T06:31:25.249ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2185 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = b4a4b551-8594-4aab-bfc4-49faf7961813 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
10182024-11-14T06:31:26.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = bf464fe4-549f-4d9d-b81d-fd8e61f47e5a roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
10192024-11-14T06:31:26.272ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = bf464fe4-549f-4d9d-b81d-fd8e61f47e5a resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
10202024-11-14T06:31:26.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2175 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = bf464fe4-549f-4d9d-b81d-fd8e61f47e5a response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
10212024-11-14T06:31:27.295ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = b6235c8a-200f-4fa2-8a8b-4686fe090d43 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
10222024-11-14T06:31:27.295ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = b6235c8a-200f-4fa2-8a8b-4686fe090d43 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
10232024-11-14T06:31:27.297ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1747 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = b6235c8a-200f-4fa2-8a8b-4686fe090d43 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
10242024-11-14T06:31:28.318ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = db17efc4-14ec-47c6-bb41-a82e88927a83 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
10252024-11-14T06:31:28.318ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = db17efc4-14ec-47c6-bb41-a82e88927a83 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
10262024-11-14T06:31:28.320ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2343 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = db17efc4-14ec-47c6-bb41-a82e88927a83 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
10272024-11-14T06:31:29.341ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 84b7c89e-5f9b-42ab-a05a-f84a047270f5 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
10282024-11-14T06:31:29.341ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 84b7c89e-5f9b-42ab-a05a-f84a047270f5 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
10292024-11-14T06:31:29.343ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2643 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 84b7c89e-5f9b-42ab-a05a-f84a047270f5 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
10302024-11-14T06:31:29.574ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
10312024-11-14T06:31:29.574ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
10322024-11-14T06:31:29.574ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10332024-11-14T06:31:29.574ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10342024-11-14T06:31:29.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
10352024-11-14T06:31:29.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
10362024-11-14T06:31:29.574ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
10372024-11-14T06:31:29.574ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
10382024-11-14T06:31:29.574ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
10392024-11-14T06:31:29.574ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
10402024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
10412024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
10422024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
10432024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
10442024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
10452024-11-14T06:31:29.575ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 06:21:29.574932505 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
10462024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
10472024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
10482024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
10492024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10502024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
10512024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
10522024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
10532024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
10542024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
10552024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
10562024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
10572024-11-14T06:31:29.575ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 1d98d624-72d4-4466-8fe7-990461a3f886
10582024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.151\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"1d98d624-72d4-4466-8fe7-990461a3f886"}
10592024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
10602024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
10612024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10622024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
10632024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
10642024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
10652024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Timeout
10662024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10672024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
10682024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
10692024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
10702024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10712024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
10722024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
10732024-11-14T06:31:29.575ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
10742024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
10752024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
10762024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10772024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
10782024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
10792024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10802024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
10812024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
10822024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
10832024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
10842024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
10852024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
10862024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
10872024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
10882024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10892024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10902024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
10912024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
10922024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10932024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
10942024-11-14T06:31:29.575ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
10952024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10962024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
10972024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
10982024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
10992024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11002024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
11012024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11022024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
11032024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11042024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11052024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
11062024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
11072024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
11082024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
11092024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11102024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
11112024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11122024-11-14T06:31:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
11132024-11-14T06:31:29.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
11142024-11-14T06:31:29.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
11152024-11-14T06:31:29.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11162024-11-14T06:31:29.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11172024-11-14T06:31:29.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
11182024-11-14T06:31:29.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11192024-11-14T06:31:29.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
11202024-11-14T06:31:29.576ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("720ac48b-8596-4763-a661-482d124c0a16.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f40de7f6-4bc1-4578-baeb-b08e777b4bed.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f40de7f6-4bc1-4578-baeb-b08e777b4bed.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1746, tv_nsec: 134057037 } })
11212024-11-14T06:31:29.576ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("36c202a9-b541-4083-88f5-ff6483340b34.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("78c1624f-34e7-40fb-a468-bb6354445b73.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d40cb6d7-78a4-49d0-ae26-45907e21e06a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d40cb6d7-78a4-49d0-ae26-45907e21e06a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1746, tv_nsec: 134059266 } })
11222024-11-14T06:31:29.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11232024-11-14T06:31:29.576ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11242024-11-14T06:31:29.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11252024-11-14T06:31:29.576ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11262024-11-14T06:31:29.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11272024-11-14T06:31:29.576ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11282024-11-14T06:31:29.576ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
11292024-11-14T06:31:29.576ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.336585ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
11302024-11-14T06:31:29.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11312024-11-14T06:31:29.576ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
11322024-11-14T06:31:29.576ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.413226ms iteration = 13 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
11332024-11-14T06:31:29.579ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11342024-11-14T06:31:29.581ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.556162ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
11352024-11-14T06:31:29.582ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11362024-11-14T06:31:29.582ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
11372024-11-14T06:31:29.582ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11382024-11-14T06:31:29.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11392024-11-14T06:31:29.582ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
11402024-11-14T06:31:29.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
11412024-11-14T06:31:29.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
11422024-11-14T06:31:29.584ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11432024-11-14T06:31:29.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11442024-11-14T06:31:29.590ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11452024-11-14T06:31:29.590ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 06:21:29.574932505 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
11462024-11-14T06:31:29.590ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 15.883336ms iteration = 13 status = {"expiration":"2024-11-14T06:21:29.574932505Z","pruned":[]}
11472024-11-14T06:31:29.591ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
11482024-11-14T06:31:29.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
11492024-11-14T06:31:29.592ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11502024-11-14T06:31:29.593ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1746, tv_nsec: 151698275 } })
11512024-11-14T06:31:29.593ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
11522024-11-14T06:31:29.594ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
11532024-11-14T06:31:29.594ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11542024-11-14T06:31:29.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11552024-11-14T06:31:29.595ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
11562024-11-14T06:31:29.595ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11572024-11-14T06:31:29.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11582024-11-14T06:31:29.598ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1746, tv_nsec: 156194719 } })
11592024-11-14T06:31:29.598ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
11602024-11-14T06:31:29.599ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11612024-11-14T06:31:29.602ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
11622024-11-14T06:31:29.602ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
11632024-11-14T06:31:29.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
11642024-11-14T06:31:29.608ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 32.866142ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
11652024-11-14T06:31:29.612ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11662024-11-14T06:31:29.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11672024-11-14T06:31:29.615ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11682024-11-14T06:31:29.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11692024-11-14T06:31:29.619ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1746, tv_nsec: 177734159 } })
11702024-11-14T06:31:29.619ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
11712024-11-14T06:31:29.621ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11722024-11-14T06:31:29.624ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
11732024-11-14T06:31:29.633ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11742024-11-14T06:31:29.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11752024-11-14T06:31:29.639ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11762024-11-14T06:31:29.643ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
11772024-11-14T06:31:29.648ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11782024-11-14T06:31:29.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11792024-11-14T06:31:29.650ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11802024-11-14T06:31:29.653ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
11812024-11-14T06:31:29.653ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
11822024-11-14T06:31:29.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
11832024-11-14T06:31:29.655ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
11842024-11-14T06:31:29.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
11852024-11-14T06:31:29.656ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11862024-11-14T06:31:29.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11872024-11-14T06:31:29.657ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11882024-11-14T06:31:29.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11892024-11-14T06:31:29.660ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11902024-11-14T06:31:29.660ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11912024-11-14T06:31:29.663ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
11922024-11-14T06:31:29.663ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11932024-11-14T06:31:29.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11942024-11-14T06:31:29.664ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11952024-11-14T06:31:29.664ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11962024-11-14T06:31:29.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11972024-11-14T06:31:29.664ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11982024-11-14T06:31:29.665ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
11992024-11-14T06:31:29.665ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12002024-11-14T06:31:29.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
12012024-11-14T06:31:29.666ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 91.215058ms iteration = 25 status = {"errors":[],"records_set_to_done":[]}
12022024-11-14T06:31:29.666ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
12032024-11-14T06:31:29.667ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12042024-11-14T06:31:29.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12052024-11-14T06:31:29.667ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12062024-11-14T06:31:29.668ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
12072024-11-14T06:31:29.668ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12082024-11-14T06:31:29.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12092024-11-14T06:31:29.669ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
12102024-11-14T06:31:29.669ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12112024-11-14T06:31:29.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12122024-11-14T06:31:29.671ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
12132024-11-14T06:31:29.671ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
12142024-11-14T06:31:29.671ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
12152024-11-14T06:31:29.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
12162024-11-14T06:31:29.672ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 96.942165ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
12172024-11-14T06:31:29.672ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12182024-11-14T06:31:29.672ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
12192024-11-14T06:31:29.672ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
12202024-11-14T06:31:29.672ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 97.387582ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
12212024-11-14T06:31:29.673ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12222024-11-14T06:31:29.676ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12232024-11-14T06:31:29.676ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12242024-11-14T06:31:29.676ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12252024-11-14T06:31:29.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12262024-11-14T06:31:29.677ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
12272024-11-14T06:31:29.677ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12282024-11-14T06:31:29.677ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
12292024-11-14T06:31:29.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12302024-11-14T06:31:29.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
12312024-11-14T06:31:29.679ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
12322024-11-14T06:31:29.679ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12332024-11-14T06:31:29.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12342024-11-14T06:31:29.680ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
12352024-11-14T06:31:29.680ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
12362024-11-14T06:31:29.680ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
12372024-11-14T06:31:29.680ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12382024-11-14T06:31:29.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12392024-11-14T06:31:29.681ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12402024-11-14T06:31:29.683ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
12412024-11-14T06:31:29.683ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
12422024-11-14T06:31:29.683ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
12432024-11-14T06:31:29.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
12442024-11-14T06:31:29.683ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12452024-11-14T06:31:29.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12462024-11-14T06:31:29.684ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
12472024-11-14T06:31:29.684ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12482024-11-14T06:31:29.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12492024-11-14T06:31:29.686ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 111.132579ms iteration = 6 status = {"nsuccess":5}
12502024-11-14T06:31:29.687ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12512024-11-14T06:31:29.687ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12522024-11-14T06:31:29.691ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
12532024-11-14T06:31:29.691ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12542024-11-14T06:31:29.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12552024-11-14T06:31:29.692ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
12562024-11-14T06:31:29.692ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12572024-11-14T06:31:29.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12582024-11-14T06:31:29.696ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
12592024-11-14T06:31:29.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
12602024-11-14T06:31:29.698ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
12612024-11-14T06:31:29.698ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
12622024-11-14T06:31:29.698ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
12632024-11-14T06:31:29.698ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
12642024-11-14T06:31:29.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
12652024-11-14T06:31:29.703ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12662024-11-14T06:31:29.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12672024-11-14T06:31:29.710ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
12682024-11-14T06:31:29.710ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 135.242238ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
12692024-11-14T06:31:29.711ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
12702024-11-14T06:31:29.711ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
12712024-11-14T06:31:29.711ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 136.109914ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
12722024-11-14T06:31:29.712ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 136.841097ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12732024-11-14T06:31:29.712ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 137.432178ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
12742024-11-14T06:31:29.719ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
12752024-11-14T06:31:29.719ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
12762024-11-14T06:31:29.719ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 144.485969ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
12772024-11-14T06:31:29.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
12782024-11-14T06:31:29.720ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12792024-11-14T06:31:29.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12802024-11-14T06:31:29.723ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 147.70807ms iteration = 25 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
12812024-11-14T06:31:29.725ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
12822024-11-14T06:31:29.725ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
12832024-11-14T06:31:29.725ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 150.063753ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
12842024-11-14T06:31:29.726ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
12852024-11-14T06:31:29.727ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
12862024-11-14T06:31:29.727ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 30e11b92-f705-4c8e-bce7-d646f8ce00cf dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
12872024-11-14T06:31:29.727ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12882024-11-14T06:31:29.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12892024-11-14T06:31:29.742ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12902024-11-14T06:31:29.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12912024-11-14T06:31:29.785ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 210.994908ms iteration = 28 status = {"physical_disks_added":0}
12922024-11-14T06:31:29.829ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
12932024-11-14T06:31:29.829ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12942024-11-14T06:31:29.829ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6a711488-f7fa-435e-9a8b-62a1ed755151", "content-length": "26", "date": "Thu, 14 Nov 2024 06:31:29 GMT"} })
12952024-11-14T06:31:29.829ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12962024-11-14T06:31:29.831ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
12972024-11-14T06:31:29.839ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36021 req_id = e5170793-3f1c-4851-8d11-d8e3c94e67c3 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
12982024-11-14T06:31:29.839ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36021 req_id = e5170793-3f1c-4851-8d11-d8e3c94e67c3 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
12992024-11-14T06:31:29.894ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
13002024-11-14T06:31:29.900ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
13012024-11-14T06:31:29.921ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
13022024-11-14T06:31:29.921ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
13032024-11-14T06:31:29.922ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "cbe11572-62d0-45a4-9f8e-0b6bdaef6e0c", "content-length": "372", "date": "Thu, 14 Nov 2024 06:31:29 GMT"} })
13042024-11-14T06:31:29.922ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13052024-11-14T06:31:29.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13062024-11-14T06:31:29.925ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13072024-11-14T06:31:29.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13082024-11-14T06:31:29.926ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13092024-11-14T06:31:29.928ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89124 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36021 req_id = e5170793-3f1c-4851-8d11-d8e3c94e67c3 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
13102024-11-14T06:31:29.928ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
13112024-11-14T06:31:29.928ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13122024-11-14T06:31:29.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13132024-11-14T06:31:29.967ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 391.890714ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
13142024-11-14T06:31:29.971ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13152024-11-14T06:31:29.973ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13162024-11-14T06:31:29.976ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
13172024-11-14T06:31:29.976ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13182024-11-14T06:31:29.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13192024-11-14T06:31:29.976ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13202024-11-14T06:31:29.977ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
13212024-11-14T06:31:29.977ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
13222024-11-14T06:31:29.977ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb9617af-13ca-465a-878e-2b1d9faf28b3", "content-length": "26", "date": "Thu, 14 Nov 2024 06:31:29 GMT"} })
13232024-11-14T06:31:29.977ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
13242024-11-14T06:31:29.978ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
13252024-11-14T06:31:29.978ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13262024-11-14T06:31:29.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13272024-11-14T06:31:29.979ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T06:19:27.309503Z, time_modified: 2024-11-14T06:19:27.309503Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, db_silo: Silo { identity: SiloIdentity { id: 95153e51-68aa-4bd4-8e65-b8164172811d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T06:19:31.569300Z, time_modified: 2024-11-14T06:19:31.569300Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, db_silo: Silo { identity: SiloIdentity { id: 95153e51-68aa-4bd4-8e65-b8164172811d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T06:19:31.569300Z, time_modified: 2024-11-14T06:19:31.569300Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89" }] }) }
13282024-11-14T06:31:29.979ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 404.270515ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"95153e51-68aa-4bd4-8e65-b8164172811d","tls_certs":["3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89"]}},"default_endpoint":{"silo_id":"95153e51-68aa-4bd4-8e65-b8164172811d","tls_certs":["3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
13292024-11-14T06:31:29.979ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 27a56cb4-44ff-4d5b-931e-1c2c0642844d, lookup_type: ById(27a56cb4-44ff-4d5b-931e-1c2c0642844d) } result = Ok(())
13302024-11-14T06:31:29.980ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13312024-11-14T06:31:29.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13322024-11-14T06:31:29.980ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
13332024-11-14T06:31:29.982ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 30e11b92-f705-4c8e-bce7-d646f8ce00cf dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
13342024-11-14T06:31:29.982ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
13352024-11-14T06:31:29.982ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-14 06:19:30.340423 UTC dns_group = internal generation = 1
13362024-11-14T06:31:29.982ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 407.898262ms iteration = 13 status = {"generation":1}
13372024-11-14T06:31:29.982ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 408.009134ms iteration = 25 status = 0
13382024-11-14T06:31:29.993ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 418.752745ms iteration = 25 status = {}
13392024-11-14T06:31:29.996ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
13402024-11-14T06:31:29.996ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
13412024-11-14T06:31:29.996ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "4801fb75-0865-4cb1-933e-0951c3853815", "date": "Thu, 14 Nov 2024 06:31:29 GMT"} })
13422024-11-14T06:31:29.996ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13432024-11-14T06:31:29.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13442024-11-14T06:31:29.999ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13452024-11-14T06:31:29.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13462024-11-14T06:31:30.002ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13472024-11-14T06:31:30.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13482024-11-14T06:31:30.007ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
13492024-11-14T06:31:30.007ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
13502024-11-14T06:31:30.009ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 zone_address = fd00:1122:3344:101::2
13512024-11-14T06:31:30.009ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
13522024-11-14T06:31:30.009ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a80c5d63-1f80-4e62-a487-f9ee3341fce2", "content-length": "26", "date": "Thu, 14 Nov 2024 06:31:29 GMT"} })
13532024-11-14T06:31:30.010ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
13542024-11-14T06:31:30.010ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
13552024-11-14T06:31:30.010ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = c6d59938-b455-4e7b-9d17-0d6427a65b9c dns_zone_name = oxide.test found_so_far = 0 version = 2
13562024-11-14T06:31:30.010ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13572024-11-14T06:31:30.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13582024-11-14T06:31:30.012ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
13592024-11-14T06:31:30.012ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13602024-11-14T06:31:30.016ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
13612024-11-14T06:31:30.016ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13622024-11-14T06:31:30.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13632024-11-14T06:31:30.021ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = c6d59938-b455-4e7b-9d17-0d6427a65b9c dns_zone_name = oxide.test found_so_far = 1 version = 2
13642024-11-14T06:31:30.021ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
13652024-11-14T06:31:30.021ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-14 06:19:31.616543 UTC dns_group = external generation = 2
13662024-11-14T06:31:30.021ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 446.553492ms iteration = 13 status = {"generation":2}
13672024-11-14T06:31:30.034ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
13682024-11-14T06:31:30.034ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 459.284769ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
13692024-11-14T06:31:30.038ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
13702024-11-14T06:31:30.039ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "174f740c-8e39-46d6-ac0f-85f2ccac8cbd", "date": "Thu, 14 Nov 2024 06:31:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
13712024-11-14T06:31:30.039ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
13722024-11-14T06:31:30.040ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "e75f5226-ea79-4519-87cf-7351a21d3508", "date": "Thu, 14 Nov 2024 06:31:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
13732024-11-14T06:31:30.040ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
13742024-11-14T06:31:30.041ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "c4d8672b-db68-4186-a0c8-b4e17f7e9cf1", "date": "Thu, 14 Nov 2024 06:31:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
13752024-11-14T06:31:30.041ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
13762024-11-14T06:31:30.042ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13772024-11-14T06:31:30.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13782024-11-14T06:31:30.044ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
13792024-11-14T06:31:30.044ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 469.282984ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
13802024-11-14T06:31:30.071ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
13812024-11-14T06:31:30.071ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "b1ec96c7-db55-4984-a70d-7ecd188f065b", "date": "Thu, 14 Nov 2024 06:31:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
13822024-11-14T06:31:30.071ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
13832024-11-14T06:31:30.071ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13842024-11-14T06:31:30.073ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
13852024-11-14T06:31:30.073ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13862024-11-14T06:31:30.073ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "0ff738d7-c391-4aa2-b879-c31a580145b8", "date": "Thu, 14 Nov 2024 06:31:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
13872024-11-14T06:31:30.073ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
13882024-11-14T06:31:30.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13892024-11-14T06:31:30.075ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13902024-11-14T06:31:30.076ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
13912024-11-14T06:31:30.076ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 500.878233ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
13922024-11-14T06:31:30.076ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
13932024-11-14T06:31:30.076ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c4e72514-497e-485f-8d06-454344a24ee3", "content-length": "1", "date": "Thu, 14 Nov 2024 06:31:29 GMT"} })
13942024-11-14T06:31:30.077ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
13952024-11-14T06:31:30.077ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13962024-11-14T06:31:30.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13972024-11-14T06:31:30.079ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
13982024-11-14T06:31:30.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
13992024-11-14T06:31:30.081ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 506.827694ms iteration = 25 status = null
14002024-11-14T06:31:30.109ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "542a6a74-154e-4ac7-8115-75f1620729c6", "date": "Thu, 14 Nov 2024 06:31:29 GMT"} })
14012024-11-14T06:31:30.111ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 535.716772ms iteration = 25 status = {}
14022024-11-14T06:31:30.153ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14032024-11-14T06:31:30.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14042024-11-14T06:31:30.156ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: cecfafa4-4697-4aa6-949f-23c34aa9d5bd, rack_id: f391bffc-9f2b-4c87-85cd-2718afa7cb93, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(58c91208-be0a-4936-a7c2-2ae07694e16d) } rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
14052024-11-14T06:31:30.156ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14062024-11-14T06:31:30.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14072024-11-14T06:31:30.166ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
14082024-11-14T06:31:30.166ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "7494a7c0-7e13-44f2-904e-0acec87695f2", "content-length": "134", "date": "Thu, 14 Nov 2024 06:31:29 GMT"} })
14092024-11-14T06:31:30.166ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
14102024-11-14T06:31:30.167ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 58c91208-be0a-4936-a7c2-2ae07694e16d
14112024-11-14T06:31:30.167ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
14122024-11-14T06:31:30.167ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
14132024-11-14T06:31:30.167ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
14142024-11-14T06:31:30.167ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
14152024-11-14T06:31:30.167ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
14162024-11-14T06:31:30.167ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
14172024-11-14T06:31:30.167ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
14182024-11-14T06:31:30.167ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
14192024-11-14T06:31:30.167ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
14202024-11-14T06:31:30.167ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14212024-11-14T06:31:30.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14222024-11-14T06:31:30.170ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
14232024-11-14T06:31:30.170ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "3504d2c0-42ce-4241-9dfa-a6a28e15b8e1", "content-length": "2", "date": "Thu, 14 Nov 2024 06:31:29 GMT"} })
14242024-11-14T06:31:30.170ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
14252024-11-14T06:31:30.170ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "782b22f9-d154-4f4f-ac78-c29e9010f8f8", "content-length": "52", "date": "Thu, 14 Nov 2024 06:31:29 GMT"} })
14262024-11-14T06:31:30.170ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
14272024-11-14T06:31:30.170ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
14282024-11-14T06:31:30.173ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
14292024-11-14T06:31:30.173ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "b1fd41b7-f177-4cff-aea1-89bffb6269eb", "content-length": "691", "date": "Thu, 14 Nov 2024 06:31:29 GMT"} })
14302024-11-14T06:31:30.173ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
14312024-11-14T06:31:30.173ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
14322024-11-14T06:31:30.173ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
14332024-11-14T06:31:30.175ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 600.13749ms iteration = 25 status = {}
14342024-11-14T06:31:30.307ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "ed97547d-c0e2-4104-8ff9-dddef066bc0b", "date": "Thu, 14 Nov 2024 06:31:30 GMT"} })
14352024-11-14T06:31:30.307ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch = Switch0
14362024-11-14T06:31:30.307ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
14372024-11-14T06:31:30.307ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d208e9a5-3e2b-4ce9-a87a-b06f63a4803b", "content-length": "682", "date": "Thu, 14 Nov 2024 06:31:30 GMT"} })
14382024-11-14T06:31:30.307ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14392024-11-14T06:31:30.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14402024-11-14T06:31:30.311ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14412024-11-14T06:31:30.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14422024-11-14T06:31:30.315ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14432024-11-14T06:31:30.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14442024-11-14T06:31:30.317ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14452024-11-14T06:31:30.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14462024-11-14T06:31:30.324ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 749.299347ms iteration = 25 status = {}
14472024-11-14T06:31:30.363ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 8df5d7b4-73b2-42a7-be21-04190951adf2 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
14482024-11-14T06:31:30.363ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 8df5d7b4-73b2-42a7-be21-04190951adf2 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
14492024-11-14T06:31:30.365ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1931 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 8df5d7b4-73b2-42a7-be21-04190951adf2 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
14502024-11-14T06:31:31.385ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = e8bcaad8-9713-4bfb-bc88-eefa3e34cc30 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
14512024-11-14T06:31:31.385ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = e8bcaad8-9713-4bfb-bc88-eefa3e34cc30 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
14522024-11-14T06:31:31.388ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3641 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = e8bcaad8-9713-4bfb-bc88-eefa3e34cc30 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
14532024-11-14T06:31:32.419ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 99e0ec29-2c8e-45b0-9821-420108c45212 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
14542024-11-14T06:31:32.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 99e0ec29-2c8e-45b0-9821-420108c45212 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
14552024-11-14T06:31:32.422ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2632 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 99e0ec29-2c8e-45b0-9821-420108c45212 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
14562024-11-14T06:31:33.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 33091db9-8626-42f7-a1f5-7d9bc6a0dd7c roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
14572024-11-14T06:31:33.444ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 33091db9-8626-42f7-a1f5-7d9bc6a0dd7c resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
14582024-11-14T06:31:33.446ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2190 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 33091db9-8626-42f7-a1f5-7d9bc6a0dd7c response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
14592024-11-14T06:31:34.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 525db6f6-e59e-44c1-9105-c31d625d4d89 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
14602024-11-14T06:31:34.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 525db6f6-e59e-44c1-9105-c31d625d4d89 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
14612024-11-14T06:31:34.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2464 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 525db6f6-e59e-44c1-9105-c31d625d4d89 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
14622024-11-14T06:31:35.492ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 6d24024c-2e03-42ac-88bc-a4fbafb1d15b roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
14632024-11-14T06:31:35.492ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 6d24024c-2e03-42ac-88bc-a4fbafb1d15b resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
14642024-11-14T06:31:35.494ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1844 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 6d24024c-2e03-42ac-88bc-a4fbafb1d15b response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
14652024-11-14T06:31:36.514ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 2df280d2-86c5-40b0-b8df-54c7ba82f0c5 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
14662024-11-14T06:31:36.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 2df280d2-86c5-40b0-b8df-54c7ba82f0c5 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
14672024-11-14T06:31:36.516ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2158 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 2df280d2-86c5-40b0-b8df-54c7ba82f0c5 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
14682024-11-14T06:31:37.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 2b796bcb-c7a8-4e07-8b5a-138f861fcd7c roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
14692024-11-14T06:31:37.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 2b796bcb-c7a8-4e07-8b5a-138f861fcd7c resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
14702024-11-14T06:31:37.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2355 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 2b796bcb-c7a8-4e07-8b5a-138f861fcd7c response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
14712024-11-14T06:31:37.606ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 532 local_addr = [fd00:1122:3344:101::c]:60882 method = GET remote_addr = [fd00:1122:3344:101::d]:64488 req_id = 218ab85d-6e53-43b8-ac2e-e7192dfa0b9b response_code = 200 uri = /80190dc3-d884-49a0-b9a3-38d31e8c655a
14722024-11-14T06:31:38.560ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = cbecbf47-2464-4ffd-b003-5ec0e6f25ffd roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
14732024-11-14T06:31:38.560ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = cbecbf47-2464-4ffd-b003-5ec0e6f25ffd resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
14742024-11-14T06:31:38.562ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1832 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = cbecbf47-2464-4ffd-b003-5ec0e6f25ffd response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
14752024-11-14T06:31:39.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
14762024-11-14T06:31:39.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
14772024-11-14T06:31:39.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14782024-11-14T06:31:39.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14792024-11-14T06:31:39.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14802024-11-14T06:31:39.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14812024-11-14T06:31:39.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14822024-11-14T06:31:39.576ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14832024-11-14T06:31:39.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14842024-11-14T06:31:39.578ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14852024-11-14T06:31:39.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14862024-11-14T06:31:39.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14872024-11-14T06:31:39.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14882024-11-14T06:31:39.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14892024-11-14T06:31:39.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 911239c7-d9f8-4eae-83e5-860d36827fb9 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
14902024-11-14T06:31:39.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 911239c7-d9f8-4eae-83e5-860d36827fb9 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
14912024-11-14T06:31:39.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14922024-11-14T06:31:39.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1810 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 911239c7-d9f8-4eae-83e5-860d36827fb9 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
14932024-11-14T06:31:39.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
14942024-11-14T06:31:39.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14952024-11-14T06:31:39.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14962024-11-14T06:31:39.596ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
14972024-11-14T06:31:39.596ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.842156ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
14982024-11-14T06:31:39.606ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.71198ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14992024-11-14T06:31:40.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = be4688dc-6a16-4eec-a125-017c2d1fa7df roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
15002024-11-14T06:31:40.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = be4688dc-6a16-4eec-a125-017c2d1fa7df resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
15012024-11-14T06:31:40.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2124 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = be4688dc-6a16-4eec-a125-017c2d1fa7df response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
15022024-11-14T06:31:40.940ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36021 req_id = 6f7a3354-d6a4-430e-975c-be1337376250 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
15032024-11-14T06:31:40.940ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36021 req_id = 6f7a3354-d6a4-430e-975c-be1337376250 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
15042024-11-14T06:31:40.946ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6061 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36021 req_id = 6f7a3354-d6a4-430e-975c-be1337376250 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
15052024-11-14T06:31:40.948ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36021 req_id = 4592bedb-2248-4bd3-b09e-85b96bae8901 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
15062024-11-14T06:31:40.948ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36021 req_id = 4592bedb-2248-4bd3-b09e-85b96bae8901 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
15072024-11-14T06:31:40.951ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3460 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36021 req_id = 4592bedb-2248-4bd3-b09e-85b96bae8901 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
15082024-11-14T06:31:41.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 79add2e0-8682-4825-a769-a4817541ed9b roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
15092024-11-14T06:31:41.628ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 79add2e0-8682-4825-a769-a4817541ed9b resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
15102024-11-14T06:31:41.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2196 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 79add2e0-8682-4825-a769-a4817541ed9b response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
15112024-11-14T06:31:42.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 2e3364d0-64aa-4312-b06c-575d1df3cbd3 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
15122024-11-14T06:31:42.652ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 2e3364d0-64aa-4312-b06c-575d1df3cbd3 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
15132024-11-14T06:31:42.654ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2179 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 2e3364d0-64aa-4312-b06c-575d1df3cbd3 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
15142024-11-14T06:31:43.674ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 6465b906-cfe7-490a-95d3-e287c807a3dd roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
15152024-11-14T06:31:43.675ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 6465b906-cfe7-490a-95d3-e287c807a3dd resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
15162024-11-14T06:31:43.678ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3818 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 6465b906-cfe7-490a-95d3-e287c807a3dd response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
15172024-11-14T06:31:44.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 0033471d-4245-4e53-9c39-a6aa35cf51d6 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
15182024-11-14T06:31:44.708ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 0033471d-4245-4e53-9c39-a6aa35cf51d6 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
15192024-11-14T06:31:44.710ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2351 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 0033471d-4245-4e53-9c39-a6aa35cf51d6 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
15202024-11-14T06:31:45.733ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 26b1a5b8-52e3-4542-bd20-3b4d2666fe5f roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
15212024-11-14T06:31:45.733ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 26b1a5b8-52e3-4542-bd20-3b4d2666fe5f resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
15222024-11-14T06:31:45.734ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1883 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 26b1a5b8-52e3-4542-bd20-3b4d2666fe5f response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
15232024-11-14T06:31:46.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 27eed44f-6e2c-4ba7-a2f6-67d44d85a394 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
15242024-11-14T06:31:46.756ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 27eed44f-6e2c-4ba7-a2f6-67d44d85a394 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
15252024-11-14T06:31:46.758ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2435 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 27eed44f-6e2c-4ba7-a2f6-67d44d85a394 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
15262024-11-14T06:31:47.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = d4ee6ffa-432b-4223-90c2-d49d1b9278b9 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
15272024-11-14T06:31:47.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = d4ee6ffa-432b-4223-90c2-d49d1b9278b9 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
15282024-11-14T06:31:47.783ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2581 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = d4ee6ffa-432b-4223-90c2-d49d1b9278b9 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
15292024-11-14T06:31:48.462ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = cfc37030-f2c9-4bb4-a779-ab660b5b818c remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 66edba49-f183-4b05-ad91-3153b7748fde uri = /vmms/cfc37030-f2c9-4bb4-a779-ab660b5b818c vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-14T06:31:48.443857253Z }
15302024-11-14T06:31:48.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 66edba49-f183-4b05-ad91-3153b7748fde roles = RoleSet { roles: {} } uri = /vmms/cfc37030-f2c9-4bb4-a779-ab660b5b818c
15312024-11-14T06:31:48.462ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 66edba49-f183-4b05-ad91-3153b7748fde resource = Database result = Ok(()) uri = /vmms/cfc37030-f2c9-4bb4-a779-ab660b5b818c
15322024-11-14T06:31:48.511ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67406 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 66edba49-f183-4b05-ad91-3153b7748fde response_code = 204 uri = /vmms/cfc37030-f2c9-4bb4-a779-ab660b5b818c
15332024-11-14T06:31:48.512ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = cfc37030-f2c9-4bb4-a779-ab660b5b818c remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 2fb6ca3c-8374-4b6a-90dd-0a1afd6c1058 uri = /vmms/cfc37030-f2c9-4bb4-a779-ab660b5b818c vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-14T06:31:48.511942970Z }
15342024-11-14T06:31:48.512ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 2fb6ca3c-8374-4b6a-90dd-0a1afd6c1058 roles = RoleSet { roles: {} } uri = /vmms/cfc37030-f2c9-4bb4-a779-ab660b5b818c
15352024-11-14T06:31:48.512ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 2fb6ca3c-8374-4b6a-90dd-0a1afd6c1058 resource = Database result = Ok(()) uri = /vmms/cfc37030-f2c9-4bb4-a779-ab660b5b818c
15362024-11-14T06:31:48.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46229 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 2fb6ca3c-8374-4b6a-90dd-0a1afd6c1058 response_code = 204 uri = /vmms/cfc37030-f2c9-4bb4-a779-ab660b5b818c
15372024-11-14T06:31:48.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 6420695d-4b8c-43cf-bd7e-a9b2764fd0e4 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
15382024-11-14T06:31:48.806ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 6420695d-4b8c-43cf-bd7e-a9b2764fd0e4 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
15392024-11-14T06:31:48.807ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2097 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 6420695d-4b8c-43cf-bd7e-a9b2764fd0e4 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
15402024-11-14T06:31:49.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
15412024-11-14T06:31:49.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15422024-11-14T06:31:49.573ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
15432024-11-14T06:31:49.573ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15442024-11-14T06:31:49.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15452024-11-14T06:31:49.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15462024-11-14T06:31:49.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15472024-11-14T06:31:49.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
15482024-11-14T06:31:49.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15492024-11-14T06:31:49.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15502024-11-14T06:31:49.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15512024-11-14T06:31:49.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15522024-11-14T06:31:49.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15532024-11-14T06:31:49.586ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
15542024-11-14T06:31:49.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15552024-11-14T06:31:49.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15562024-11-14T06:31:49.596ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
15572024-11-14T06:31:49.596ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.996768ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
15582024-11-14T06:31:49.603ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15592024-11-14T06:31:49.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15602024-11-14T06:31:49.639ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 65.425738ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
15612024-11-14T06:31:49.829ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 541d8289-9fa8-41bf-84a3-98c6616f48b9 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
15622024-11-14T06:31:49.829ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 541d8289-9fa8-41bf-84a3-98c6616f48b9 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
15632024-11-14T06:31:49.831ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2400 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 541d8289-9fa8-41bf-84a3-98c6616f48b9 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
15642024-11-14T06:31:50.853ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 76f3cbb8-1348-456f-a4eb-8dfde28d59b0 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
15652024-11-14T06:31:50.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 76f3cbb8-1348-456f-a4eb-8dfde28d59b0 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
15662024-11-14T06:31:50.855ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2290 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 76f3cbb8-1348-456f-a4eb-8dfde28d59b0 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
15672024-11-14T06:31:51.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 4954107b-f541-4d37-8a58-bbdd02e0c083 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
15682024-11-14T06:31:51.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 4954107b-f541-4d37-8a58-bbdd02e0c083 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
15692024-11-14T06:31:51.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2416 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 4954107b-f541-4d37-8a58-bbdd02e0c083 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
15702024-11-14T06:31:52.606ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 626 local_addr = [fd00:1122:3344:101::c]:60882 method = GET remote_addr = [fd00:1122:3344:101::d]:64488 req_id = 931ca65e-3d8a-42fe-8ce7-01a22d9b5ccd response_code = 200 uri = /80190dc3-d884-49a0-b9a3-38d31e8c655a
15712024-11-14T06:31:52.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 62a8a546-1d34-458d-9d7d-0daa09614172 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
15722024-11-14T06:31:52.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 62a8a546-1d34-458d-9d7d-0daa09614172 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
15732024-11-14T06:31:52.904ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2111 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 62a8a546-1d34-458d-9d7d-0daa09614172 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
15742024-11-14T06:31:53.926ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 04c8d671-d78e-4a31-acc3-d77af08050da roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
15752024-11-14T06:31:53.926ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 04c8d671-d78e-4a31-acc3-d77af08050da resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
15762024-11-14T06:31:53.928ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2699 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 04c8d671-d78e-4a31-acc3-d77af08050da response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
15772024-11-14T06:31:54.949ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f2424d09-fd1a-41c2-b2c5-86992982dbae roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
15782024-11-14T06:31:54.950ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f2424d09-fd1a-41c2-b2c5-86992982dbae resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
15792024-11-14T06:31:54.952ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2465 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f2424d09-fd1a-41c2-b2c5-86992982dbae response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
15802024-11-14T06:31:55.973ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = d0cb7fce-9187-4412-a2aa-9f9f18dae991 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
15812024-11-14T06:31:55.973ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = d0cb7fce-9187-4412-a2aa-9f9f18dae991 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
15822024-11-14T06:31:55.975ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2506 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = d0cb7fce-9187-4412-a2aa-9f9f18dae991 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
15832024-11-14T06:31:56.996ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = c06bb3f9-a385-4c29-8f2a-41c02caf74fb roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
15842024-11-14T06:31:56.996ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = c06bb3f9-a385-4c29-8f2a-41c02caf74fb resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
15852024-11-14T06:31:56.998ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2039 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = c06bb3f9-a385-4c29-8f2a-41c02caf74fb response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
15862024-11-14T06:31:58.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 961f82a7-36d1-4a85-9f98-77a3716763ab roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
15872024-11-14T06:31:58.018ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 961f82a7-36d1-4a85-9f98-77a3716763ab resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
15882024-11-14T06:31:58.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1886 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 961f82a7-36d1-4a85-9f98-77a3716763ab response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
15892024-11-14T06:31:58.295ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = cfc37030-f2c9-4bb4-a779-ab660b5b818c remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f5dd7a08-03c1-4cd6-998f-c4596ab125d3 uri = /vmms/cfc37030-f2c9-4bb4-a779-ab660b5b818c vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-14T06:31:58.295440351Z }
15902024-11-14T06:31:58.295ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f5dd7a08-03c1-4cd6-998f-c4596ab125d3 roles = RoleSet { roles: {} } uri = /vmms/cfc37030-f2c9-4bb4-a779-ab660b5b818c
15912024-11-14T06:31:58.296ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f5dd7a08-03c1-4cd6-998f-c4596ab125d3 resource = Database result = Ok(()) uri = /vmms/cfc37030-f2c9-4bb4-a779-ab660b5b818c
15922024-11-14T06:31:58.307ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 12296 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f5dd7a08-03c1-4cd6-998f-c4596ab125d3 response_code = 204 uri = /vmms/cfc37030-f2c9-4bb4-a779-ab660b5b818c
15932024-11-14T06:31:58.970ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36021 req_id = 0dc26457-9885-4591-a7d7-8f3e1a8d1a39 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
15942024-11-14T06:31:58.970ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36021 req_id = 0dc26457-9885-4591-a7d7-8f3e1a8d1a39 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
15952024-11-14T06:31:58.973ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3866 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36021 req_id = 0dc26457-9885-4591-a7d7-8f3e1a8d1a39 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
15962024-11-14T06:31:58.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36021 req_id = 5ddf76f2-205a-401c-995b-d1b5245b9013 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/12?limit=100
15972024-11-14T06:31:58.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36021 req_id = 5ddf76f2-205a-401c-995b-d1b5245b9013 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/12?limit=100
15982024-11-14T06:31:58.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3244 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36021 req_id = 5ddf76f2-205a-401c-995b-d1b5245b9013 response_code = 200 uri = /nat/ipv4/changeset/12?limit=100
15992024-11-14T06:31:59.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = e04dc081-c730-4ac8-873b-215a72585e22 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
16002024-11-14T06:31:59.042ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = e04dc081-c730-4ac8-873b-215a72585e22 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
16012024-11-14T06:31:59.044ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2680 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = e04dc081-c730-4ac8-873b-215a72585e22 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
16022024-11-14T06:31:59.574ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
16032024-11-14T06:31:59.574ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
16042024-11-14T06:31:59.574ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16052024-11-14T06:31:59.574ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
16062024-11-14T06:31:59.574ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
16072024-11-14T06:31:59.574ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
16082024-11-14T06:31:59.574ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16092024-11-14T06:31:59.574ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
16102024-11-14T06:31:59.574ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Timeout
16112024-11-14T06:31:59.574ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16122024-11-14T06:31:59.574ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
16132024-11-14T06:31:59.574ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
16142024-11-14T06:31:59.574ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
16152024-11-14T06:31:59.574ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
16162024-11-14T06:31:59.574ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
16172024-11-14T06:31:59.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
16182024-11-14T06:31:59.574ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
16192024-11-14T06:31:59.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16202024-11-14T06:31:59.574ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
16212024-11-14T06:31:59.574ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16222024-11-14T06:31:59.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
16232024-11-14T06:31:59.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
16242024-11-14T06:31:59.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
16252024-11-14T06:31:59.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16262024-11-14T06:31:59.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16272024-11-14T06:31:59.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16282024-11-14T06:31:59.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16292024-11-14T06:31:59.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
16302024-11-14T06:31:59.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16312024-11-14T06:31:59.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
16322024-11-14T06:31:59.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16332024-11-14T06:31:59.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16342024-11-14T06:31:59.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
16352024-11-14T06:31:59.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
16362024-11-14T06:31:59.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
16372024-11-14T06:31:59.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
16382024-11-14T06:31:59.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
16392024-11-14T06:31:59.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
16402024-11-14T06:31:59.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
16412024-11-14T06:31:59.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
16422024-11-14T06:31:59.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
16432024-11-14T06:31:59.575ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
16442024-11-14T06:31:59.575ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
16452024-11-14T06:31:59.575ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16462024-11-14T06:31:59.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
16472024-11-14T06:31:59.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
16482024-11-14T06:31:59.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
16492024-11-14T06:31:59.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
16502024-11-14T06:31:59.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16512024-11-14T06:31:59.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
16522024-11-14T06:31:59.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
16532024-11-14T06:31:59.576ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16542024-11-14T06:31:59.577ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16552024-11-14T06:31:59.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16562024-11-14T06:31:59.577ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16572024-11-14T06:31:59.578ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.267789ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
16582024-11-14T06:31:59.578ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16592024-11-14T06:31:59.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
16602024-11-14T06:31:59.579ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16612024-11-14T06:31:59.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16622024-11-14T06:31:59.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
16632024-11-14T06:31:59.580ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16642024-11-14T06:31:59.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16652024-11-14T06:31:59.581ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16662024-11-14T06:31:59.581ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
16672024-11-14T06:31:59.581ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
16682024-11-14T06:31:59.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
16692024-11-14T06:31:59.582ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
16702024-11-14T06:31:59.582ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16712024-11-14T06:31:59.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16722024-11-14T06:31:59.583ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1776, tv_nsec: 141932053 } })
16732024-11-14T06:31:59.584ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1776, tv_nsec: 142135467 } })
16742024-11-14T06:31:59.584ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
16752024-11-14T06:31:59.584ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
16762024-11-14T06:31:59.585ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16772024-11-14T06:31:59.586ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 12.018043ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
16782024-11-14T06:31:59.587ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
16792024-11-14T06:31:59.587ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16802024-11-14T06:31:59.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16812024-11-14T06:31:59.590ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16822024-11-14T06:31:59.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16832024-11-14T06:31:59.590ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1776, tv_nsec: 148662619 } })
16842024-11-14T06:31:59.590ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16852024-11-14T06:31:59.590ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
16862024-11-14T06:31:59.591ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16872024-11-14T06:31:59.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16882024-11-14T06:31:59.593ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
16892024-11-14T06:31:59.593ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16902024-11-14T06:31:59.593ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16912024-11-14T06:31:59.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16922024-11-14T06:31:59.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16932024-11-14T06:31:59.595ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16942024-11-14T06:31:59.596ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
16952024-11-14T06:31:59.596ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16962024-11-14T06:31:59.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16972024-11-14T06:31:59.625ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 49.43535ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
16982024-11-14T06:31:59.626ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 51.311025ms iteration = 26 status = {"errors":[],"records_set_to_done":[]}
16992024-11-14T06:31:59.627ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17002024-11-14T06:31:59.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17012024-11-14T06:31:59.629ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
17022024-11-14T06:31:59.629ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
17032024-11-14T06:31:59.629ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17042024-11-14T06:31:59.629ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17052024-11-14T06:31:59.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
17062024-11-14T06:31:59.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17072024-11-14T06:31:59.630ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
17082024-11-14T06:31:59.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
17092024-11-14T06:31:59.631ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
17102024-11-14T06:31:59.631ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17112024-11-14T06:31:59.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
17122024-11-14T06:31:59.631ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17132024-11-14T06:31:59.632ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
17142024-11-14T06:31:59.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
17152024-11-14T06:31:59.635ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 27a56cb4-44ff-4d5b-931e-1c2c0642844d, lookup_type: ById(27a56cb4-44ff-4d5b-931e-1c2c0642844d) } result = Ok(())
17162024-11-14T06:31:59.635ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17172024-11-14T06:31:59.635ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17182024-11-14T06:31:59.635ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17192024-11-14T06:31:59.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17202024-11-14T06:31:59.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17212024-11-14T06:31:59.637ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 63.504462ms iteration = 26 status = 0
17222024-11-14T06:31:59.641ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17232024-11-14T06:31:59.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17242024-11-14T06:31:59.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17252024-11-14T06:31:59.646ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 71.43302ms iteration = 29 status = {"physical_disks_added":0}
17262024-11-14T06:31:59.646ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
17272024-11-14T06:31:59.646ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17282024-11-14T06:31:59.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17292024-11-14T06:31:59.654ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
17302024-11-14T06:31:59.654ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 80.100671ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
17312024-11-14T06:31:59.672ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 97.306592ms iteration = 26 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
17322024-11-14T06:31:59.673ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
17332024-11-14T06:31:59.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
17342024-11-14T06:31:59.673ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 98.750818ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
17352024-11-14T06:31:59.678ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
17362024-11-14T06:31:59.678ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
17372024-11-14T06:31:59.678ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17382024-11-14T06:31:59.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
17392024-11-14T06:31:59.683ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
17402024-11-14T06:31:59.683ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17412024-11-14T06:31:59.683ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e58306e-2ba6-4e4c-9408-83041dabe409", "content-length": "26", "date": "Thu, 14 Nov 2024 06:31:59 GMT"} })
17422024-11-14T06:31:59.683ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17432024-11-14T06:31:59.685ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
17442024-11-14T06:31:59.710ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 zone_address = fd00:1122:3344:101::2
17452024-11-14T06:31:59.710ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17462024-11-14T06:31:59.711ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "64e049d1-91ab-4cfc-95e8-cac851f7e5b6", "content-length": "26", "date": "Thu, 14 Nov 2024 06:31:59 GMT"} })
17472024-11-14T06:31:59.711ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17482024-11-14T06:31:59.713ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
17492024-11-14T06:31:59.715ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17502024-11-14T06:31:59.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17512024-11-14T06:31:59.759ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
17522024-11-14T06:31:59.760ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17532024-11-14T06:31:59.760ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb27a9b3-3406-49af-a17d-8b3e55802ef2", "content-length": "26", "date": "Thu, 14 Nov 2024 06:31:59 GMT"} })
17542024-11-14T06:31:59.760ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17552024-11-14T06:31:59.762ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
17562024-11-14T06:31:59.835ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
17572024-11-14T06:31:59.835ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "3f22463b-11a0-42ba-a78e-2415c7eda262", "content-length": "2", "date": "Thu, 14 Nov 2024 06:31:59 GMT"} })
17582024-11-14T06:31:59.836ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
17592024-11-14T06:31:59.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
17602024-11-14T06:31:59.845ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/cfc37030-f2c9-4bb4-a779-ab660b5b818c/state
17612024-11-14T06:31:59.848ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17622024-11-14T06:31:59.849ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 274.623442ms iteration = 26 status = null
17632024-11-14T06:31:59.851ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
17642024-11-14T06:31:59.851ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17652024-11-14T06:31:59.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17662024-11-14T06:31:59.853ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17672024-11-14T06:31:59.855ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
17682024-11-14T06:31:59.855ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17692024-11-14T06:31:59.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17702024-11-14T06:31:59.881ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
17712024-11-14T06:31:59.881ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
17722024-11-14T06:31:59.881ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 306.801731ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
17732024-11-14T06:31:59.881ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 305.689ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
17742024-11-14T06:31:59.962ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
17752024-11-14T06:31:59.962ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
17762024-11-14T06:31:59.962ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "0de9036e-aa29-43ec-a6de-56a7257469ee", "content-length": "581", "date": "Thu, 14 Nov 2024 06:31:59 GMT"} })
17772024-11-14T06:31:59.962ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17782024-11-14T06:31:59.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17792024-11-14T06:31:59.976ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
17802024-11-14T06:31:59.977ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "38b21ad9-db2a-4664-9a4c-134c57cff271", "content-length": "809", "date": "Thu, 14 Nov 2024 06:31:59 GMT"} })
17812024-11-14T06:31:59.977ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(748766) }} sled = sock
17822024-11-14T06:31:59.977ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
17832024-11-14T06:31:59.977ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
17842024-11-14T06:31:59.978ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 404.483168ms iteration = 26 status = {}
17852024-11-14T06:32:00.004ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {e512c863-a3a7-4159-b07b-5b9aed47edd2: {10.151.2.175: {1c5c0270-8422-4f37-a051-530b9bd30aae}, 10.151.2.176: {1c5c0270-8422-4f37-a051-530b9bd30aae}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
17862024-11-14T06:32:00.004ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
17872024-11-14T06:32:00.005ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "1553e64e-fac4-4097-8416-52feb31627ee", "date": "Thu, 14 Nov 2024 06:31:59 GMT"} })
17882024-11-14T06:32:00.005ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17892024-11-14T06:32:00.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17902024-11-14T06:32:00.008ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17912024-11-14T06:32:00.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17922024-11-14T06:32:00.011ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17932024-11-14T06:32:00.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17942024-11-14T06:32:00.015ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17952024-11-14T06:32:00.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17962024-11-14T06:32:00.018ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17972024-11-14T06:32:00.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17982024-11-14T06:32:00.018ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 443.893613ms iteration = 26 status = {}
17992024-11-14T06:32:00.021ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18002024-11-14T06:32:00.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18012024-11-14T06:32:00.025ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
18022024-11-14T06:32:00.025ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
18032024-11-14T06:32:00.025ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
18042024-11-14T06:32:00.025ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "da774dfe-ba5c-4706-846f-d77f0031f4db", "date": "Thu, 14 Nov 2024 06:31:59 GMT"} })
18052024-11-14T06:32:00.027ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 451.3279ms iteration = 26 status = {}
18062024-11-14T06:32:00.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 868c68c2-f986-4b6b-848c-8b34224cf986 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
18072024-11-14T06:32:00.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 868c68c2-f986-4b6b-848c-8b34224cf986 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
18082024-11-14T06:32:00.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1731 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 868c68c2-f986-4b6b-848c-8b34224cf986 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
18092024-11-14T06:32:00.073ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18102024-11-14T06:32:00.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18112024-11-14T06:32:00.075ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: cecfafa4-4697-4aa6-949f-23c34aa9d5bd, rack_id: f391bffc-9f2b-4c87-85cd-2718afa7cb93, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(58c91208-be0a-4936-a7c2-2ae07694e16d) } rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
18122024-11-14T06:32:00.075ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18132024-11-14T06:32:00.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18142024-11-14T06:32:00.085ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
18152024-11-14T06:32:00.085ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "4276e316-3b13-4c61-bd73-2432bed46978", "content-length": "134", "date": "Thu, 14 Nov 2024 06:31:59 GMT"} })
18162024-11-14T06:32:00.085ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
18172024-11-14T06:32:00.085ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 58c91208-be0a-4936-a7c2-2ae07694e16d
18182024-11-14T06:32:00.085ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
18192024-11-14T06:32:00.085ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
18202024-11-14T06:32:00.085ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18212024-11-14T06:32:00.085ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18222024-11-14T06:32:00.085ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18232024-11-14T06:32:00.085ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
18242024-11-14T06:32:00.086ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18252024-11-14T06:32:00.086ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
18262024-11-14T06:32:00.086ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
18272024-11-14T06:32:00.086ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18282024-11-14T06:32:00.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18292024-11-14T06:32:00.088ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
18302024-11-14T06:32:00.088ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "a75cab0b-4e3a-46ae-94d3-80561a30626e", "content-length": "2", "date": "Thu, 14 Nov 2024 06:31:59 GMT"} })
18312024-11-14T06:32:00.088ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
18322024-11-14T06:32:00.088ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "72e27e06-8e41-4a9d-9b63-847f9389fadb", "content-length": "52", "date": "Thu, 14 Nov 2024 06:31:59 GMT"} })
18332024-11-14T06:32:00.088ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
18342024-11-14T06:32:00.088ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
18352024-11-14T06:32:00.215ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a37a959a-78ac-4e28-90c2-5b7e4c446f85", "date": "Thu, 14 Nov 2024 06:31:59 GMT"} })
18362024-11-14T06:32:00.215ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch = Switch0
18372024-11-14T06:32:00.216ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
18382024-11-14T06:32:00.216ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f7b6864-1c89-4c26-8a35-32bce338932a", "content-length": "682", "date": "Thu, 14 Nov 2024 06:31:59 GMT"} })
18392024-11-14T06:32:00.216ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18402024-11-14T06:32:00.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18412024-11-14T06:32:00.220ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18422024-11-14T06:32:00.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18432024-11-14T06:32:00.223ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18442024-11-14T06:32:00.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18452024-11-14T06:32:00.226ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18462024-11-14T06:32:00.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18472024-11-14T06:32:00.235ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 660.978614ms iteration = 26 status = {}
18482024-11-14T06:32:00.742ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = cfc37030-f2c9-4bb4-a779-ab660b5b818c remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 3180d96a-850b-4688-94ec-74bd8d5c79dd uri = /vmms/cfc37030-f2c9-4bb4-a779-ab660b5b818c vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-14T06:32:00.742217223Z }
18492024-11-14T06:32:00.742ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 3180d96a-850b-4688-94ec-74bd8d5c79dd roles = RoleSet { roles: {} } uri = /vmms/cfc37030-f2c9-4bb4-a779-ab660b5b818c
18502024-11-14T06:32:00.742ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 3180d96a-850b-4688-94ec-74bd8d5c79dd resource = Database result = Ok(()) uri = /vmms/cfc37030-f2c9-4bb4-a779-ab660b5b818c
18512024-11-14T06:32:00.751ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = cfc37030-f2c9-4bb4-a779-ab660b5b818c remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 3180d96a-850b-4688-94ec-74bd8d5c79dd uri = /vmms/cfc37030-f2c9-4bb4-a779-ab660b5b818c vmm_needs_update = true
18522024-11-14T06:32:00.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 3180d96a-850b-4688-94ec-74bd8d5c79dd roles = RoleSet { roles: {} } uri = /vmms/cfc37030-f2c9-4bb4-a779-ab660b5b818c
18532024-11-14T06:32:00.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 3180d96a-850b-4688-94ec-74bd8d5c79dd resource = Database result = Ok(()) uri = /vmms/cfc37030-f2c9-4bb4-a779-ab660b5b818c
18542024-11-14T06:32:00.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 3180d96a-850b-4688-94ec-74bd8d5c79dd roles = RoleSet { roles: {} } uri = /vmms/cfc37030-f2c9-4bb4-a779-ab660b5b818c
18552024-11-14T06:32:00.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 3180d96a-850b-4688-94ec-74bd8d5c79dd resource = Database result = Ok(()) uri = /vmms/cfc37030-f2c9-4bb4-a779-ab660b5b818c
18562024-11-14T06:32:00.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 3180d96a-850b-4688-94ec-74bd8d5c79dd roles = RoleSet { roles: {} } uri = /vmms/cfc37030-f2c9-4bb4-a779-ab660b5b818c
18572024-11-14T06:32:00.756ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 3180d96a-850b-4688-94ec-74bd8d5c79dd resource = Database result = Ok(()) uri = /vmms/cfc37030-f2c9-4bb4-a779-ab660b5b818c
18582024-11-14T06:32:00.761ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 3180d96a-850b-4688-94ec-74bd8d5c79dd roles = RoleSet { roles: {} } uri = /vmms/cfc37030-f2c9-4bb4-a779-ab660b5b818c
18592024-11-14T06:32:00.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 3180d96a-850b-4688-94ec-74bd8d5c79dd resource = Database result = Ok(()) uri = /vmms/cfc37030-f2c9-4bb4-a779-ab660b5b818c
18602024-11-14T06:32:00.763ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 3180d96a-850b-4688-94ec-74bd8d5c79dd roles = RoleSet { roles: {} } uri = /vmms/cfc37030-f2c9-4bb4-a779-ab660b5b818c
18612024-11-14T06:32:00.763ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 3180d96a-850b-4688-94ec-74bd8d5c79dd resource = Database result = Ok(()) uri = /vmms/cfc37030-f2c9-4bb4-a779-ab660b5b818c
18622024-11-14T06:32:00.764ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 3180d96a-850b-4688-94ec-74bd8d5c79dd roles = RoleSet { roles: {} } uri = /vmms/cfc37030-f2c9-4bb4-a779-ab660b5b818c
18632024-11-14T06:32:00.764ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 3180d96a-850b-4688-94ec-74bd8d5c79dd resource = Database result = Ok(()) uri = /vmms/cfc37030-f2c9-4bb4-a779-ab660b5b818c
18642024-11-14T06:32:00.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 3180d96a-850b-4688-94ec-74bd8d5c79dd roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/cfc37030-f2c9-4bb4-a779-ab660b5b818c
18652024-11-14T06:32:00.771ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 3180d96a-850b-4688-94ec-74bd8d5c79dd resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) }, key: 7978c97d-b581-4db3-bff9-bea13b3ed4db, lookup_type: ById(7978c97d-b581-4db3-bff9-bea13b3ed4db) }, key: dc849cad-a863-4ceb-a084-716be6d12072, lookup_type: ById(dc849cad-a863-4ceb-a084-716be6d12072) } result = Ok(()) uri = /vmms/cfc37030-f2c9-4bb4-a779-ab660b5b818c
18662024-11-14T06:32:00.782ZINFOnexus (dropshot_internal): starting update saga for dc849cad-a863-4ceb-a084-716be6d12072 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1618 instance_id = dc849cad-a863-4ceb-a084-716be6d12072 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 3180d96a-850b-4688-94ec-74bd8d5c79dd uri = /vmms/cfc37030-f2c9-4bb4-a779-ab660b5b818c vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-14T06:32:00.742217223Z }
18672024-11-14T06:32:00.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39749 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 3180d96a-850b-4688-94ec-74bd8d5c79dd response_code = 204 uri = /vmms/cfc37030-f2c9-4bb4-a779-ab660b5b818c
18682024-11-14T06:32:00.782ZDEBGnexus (dropshot_internal): preparing instance-update saga for dc849cad-a863-4ceb-a084-716be6d12072... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = dc849cad-a863-4ceb-a084-716be6d12072 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 3180d96a-850b-4688-94ec-74bd8d5c79dd uri = /vmms/cfc37030-f2c9-4bb4-a779-ab660b5b818c
18692024-11-14T06:32:00.782ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = eb9bb663-1daf-4de1-b79b-e64b3d6cec19 saga_name = start-instance-update
18702024-11-14T06:32:00.782ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = cfc37030-f2c9-4bb4-a779-ab660b5b818c remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 05ca1e4e-197c-453d-b9dc-627d34c87bd5 uri = /vmms/cfc37030-f2c9-4bb4-a779-ab660b5b818c vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-14T06:32:00.742217223Z }
18712024-11-14T06:32:00.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 05ca1e4e-197c-453d-b9dc-627d34c87bd5 roles = RoleSet { roles: {} } uri = /vmms/cfc37030-f2c9-4bb4-a779-ab660b5b818c
18722024-11-14T06:32:00.782ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 05ca1e4e-197c-453d-b9dc-627d34c87bd5 resource = Database result = Ok(()) uri = /vmms/cfc37030-f2c9-4bb4-a779-ab660b5b818c
18732024-11-14T06:32:00.788ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"dc849cad-a863-4ceb-a084-716be6d12072","lookup_type":{"ById":"dc849cad-a863-4ceb-a084-716be6d12072"},"parent":{"key":"7978c97d-b581-4db3-bff9-bea13b3ed4db","lookup_type":{"ById":"7978c97d-b581-4db3-bff9-bea13b3ed4db"},"parent":{"key":"95153e51-68aa-4bd4-8e65-b8164172811d","lookup_type":{"ById":"95153e51-68aa-4bd4-8e65-b8164172811d"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = eb9bb663-1daf-4de1-b79b-e64b3d6cec19 saga_name = start-instance-update sec_id = 80190dc3-d884-49a0-b9a3-38d31e8c655a
18742024-11-14T06:32:00.788ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = eb9bb663-1daf-4de1-b79b-e64b3d6cec19 saga_name = start-instance-update
18752024-11-14T06:32:00.789ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7244 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 05ca1e4e-197c-453d-b9dc-627d34c87bd5 response_code = 204 uri = /vmms/cfc37030-f2c9-4bb4-a779-ab660b5b818c
18762024-11-14T06:32:00.790ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/cfc37030-f2c9-4bb4-a779-ab660b5b818c/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "fce2c818-4945-4e1f-8acf-8e108e5e82ff", "content-length": "132", "date": "Thu, 14 Nov 2024 06:31:59 GMT"} })
18772024-11-14T06:32:00.793ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = dc849cad-a863-4ceb-a084-716be6d12072 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-14T06:32:00.742217223Z }, migration_in: None, migration_out: None } vmm_id = cfc37030-f2c9-4bb4-a779-ab660b5b818c
18782024-11-14T06:32:00.793ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2151 instance_id = dc849cad-a863-4ceb-a084-716be6d12072 migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = cfc37030-f2c9-4bb4-a779-ab660b5b818c sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d vmm_id = cfc37030-f2c9-4bb4-a779-ab660b5b818c vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-14T06:32:00.742217223Z }
18792024-11-14T06:32:00.793ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = dc849cad-a863-4ceb-a084-716be6d12072 roles = RoleSet { roles: {} } sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d vmm_id = cfc37030-f2c9-4bb4-a779-ab660b5b818c
18802024-11-14T06:32:00.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = dc849cad-a863-4ceb-a084-716be6d12072 resource = Database result = Ok(()) sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d vmm_id = cfc37030-f2c9-4bb4-a779-ab660b5b818c
18812024-11-14T06:32:00.800ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
18822024-11-14T06:32:00.802ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 1.227827973s iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"destroyed":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
18832024-11-14T06:32:00.832ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = eb9bb663-1daf-4de1-b79b-e64b3d6cec19 saga_name = start-instance-update
18842024-11-14T06:32:00.832ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = eb9bb663-1daf-4de1-b79b-e64b3d6cec19 saga_name = start-instance-update sec_id = 80190dc3-d884-49a0-b9a3-38d31e8c655a
18852024-11-14T06:32:00.832ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 80190dc3-d884-49a0-b9a3-38d31e8c655a
18862024-11-14T06:32:00.832ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = eb9bb663-1daf-4de1-b79b-e64b3d6cec19
18872024-11-14T06:32:00.837ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 80190dc3-d884-49a0-b9a3-38d31e8c655a
18882024-11-14T06:32:00.837ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = eb9bb663-1daf-4de1-b79b-e64b3d6cec19
18892024-11-14T06:32:00.841ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 80190dc3-d884-49a0-b9a3-38d31e8c655a
18902024-11-14T06:32:00.841ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = eb9bb663-1daf-4de1-b79b-e64b3d6cec19
18912024-11-14T06:32:00.848ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 80190dc3-d884-49a0-b9a3-38d31e8c655a
18922024-11-14T06:32:00.848ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("3139ef5a-f5bc-4f72-b13a-d42da44d94e5")) node_id = 0 saga_id = eb9bb663-1daf-4de1-b79b-e64b3d6cec19
18932024-11-14T06:32:00.851ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 80190dc3-d884-49a0-b9a3-38d31e8c655a
18942024-11-14T06:32:00.851ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = eb9bb663-1daf-4de1-b79b-e64b3d6cec19
18952024-11-14T06:32:00.869ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = dc849cad-a863-4ceb-a084-716be6d12072 saga_id = eb9bb663-1daf-4de1-b79b-e64b3d6cec19 saga_name = start-instance-update
18962024-11-14T06:32:00.871ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = eb9bb663-1daf-4de1-b79b-e64b3d6cec19 saga_name = start-instance-update saga_node = LockInstance
18972024-11-14T06:32:00.872ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = eb9bb663-1daf-4de1-b79b-e64b3d6cec19 saga_name = start-instance-update saga_node = LockInstance
18982024-11-14T06:32:00.876ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = eb9bb663-1daf-4de1-b79b-e64b3d6cec19 saga_name = start-instance-update saga_node = LockInstance
18992024-11-14T06:32:00.876ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = eb9bb663-1daf-4de1-b79b-e64b3d6cec19 saga_name = start-instance-update saga_node = LockInstance
19002024-11-14T06:32:00.878ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = eb9bb663-1daf-4de1-b79b-e64b3d6cec19 saga_name = start-instance-update saga_node = LockInstance
19012024-11-14T06:32:00.878ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = eb9bb663-1daf-4de1-b79b-e64b3d6cec19 saga_name = start-instance-update saga_node = LockInstance
19022024-11-14T06:32:00.880ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = eb9bb663-1daf-4de1-b79b-e64b3d6cec19 saga_name = start-instance-update saga_node = LockInstance
19032024-11-14T06:32:00.880ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = eb9bb663-1daf-4de1-b79b-e64b3d6cec19 saga_name = start-instance-update saga_node = LockInstance
19042024-11-14T06:32:00.882ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = eb9bb663-1daf-4de1-b79b-e64b3d6cec19 saga_name = start-instance-update saga_node = LockInstance
19052024-11-14T06:32:00.882ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = eb9bb663-1daf-4de1-b79b-e64b3d6cec19 saga_name = start-instance-update saga_node = LockInstance
19062024-11-14T06:32:00.883ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = eb9bb663-1daf-4de1-b79b-e64b3d6cec19 saga_name = start-instance-update saga_node = LockInstance
19072024-11-14T06:32:00.883ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = eb9bb663-1daf-4de1-b79b-e64b3d6cec19 saga_name = start-instance-update saga_node = LockInstance
19082024-11-14T06:32:00.884ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = eb9bb663-1daf-4de1-b79b-e64b3d6cec19 saga_name = start-instance-update saga_node = LockInstance
19092024-11-14T06:32:00.887ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) }, key: 7978c97d-b581-4db3-bff9-bea13b3ed4db, lookup_type: ById(7978c97d-b581-4db3-bff9-bea13b3ed4db) }, key: dc849cad-a863-4ceb-a084-716be6d12072, lookup_type: ById(dc849cad-a863-4ceb-a084-716be6d12072) } result = Ok(()) saga_id = eb9bb663-1daf-4de1-b79b-e64b3d6cec19 saga_name = start-instance-update saga_node = LockInstance
19102024-11-14T06:32:00.887ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = dc849cad-a863-4ceb-a084-716be6d12072 saga_id = eb9bb663-1daf-4de1-b79b-e64b3d6cec19 saga_name = start-instance-update saga_node = LockInstance updater_id = 3139ef5a-f5bc-4f72-b13a-d42da44d94e5
19112024-11-14T06:32:00.887ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = eb9bb663-1daf-4de1-b79b-e64b3d6cec19 saga_name = start-instance-update saga_node = LockInstance
19122024-11-14T06:32:00.887ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = eb9bb663-1daf-4de1-b79b-e64b3d6cec19 saga_name = start-instance-update saga_node = LockInstance
19132024-11-14T06:32:00.896ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = dc849cad-a863-4ceb-a084-716be6d12072 saga_id = eb9bb663-1daf-4de1-b79b-e64b3d6cec19 saga_name = start-instance-update saga_node = LockInstance updater_id = 3139ef5a-f5bc-4f72-b13a-d42da44d94e5
19142024-11-14T06:32:00.896ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = eb9bb663-1daf-4de1-b79b-e64b3d6cec19 saga_name = start-instance-update saga_node = LockInstance
19152024-11-14T06:32:00.897ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = eb9bb663-1daf-4de1-b79b-e64b3d6cec19 saga_name = start-instance-update saga_node = LockInstance
19162024-11-14T06:32:00.901ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = dc849cad-a863-4ceb-a084-716be6d12072 locked_gen = Generation(Generation(2)) saga_id = eb9bb663-1daf-4de1-b79b-e64b3d6cec19 saga_name = start-instance-update saga_node = LockInstance updater_id = 3139ef5a-f5bc-4f72-b13a-d42da44d94e5
19172024-11-14T06:32:00.907ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 80190dc3-d884-49a0-b9a3-38d31e8c655a
19182024-11-14T06:32:00.907ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("3139ef5a-f5bc-4f72-b13a-d42da44d94e5")}) node_id = 1 saga_id = eb9bb663-1daf-4de1-b79b-e64b3d6cec19
19192024-11-14T06:32:00.911ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 80190dc3-d884-49a0-b9a3-38d31e8c655a
19202024-11-14T06:32:00.911ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = eb9bb663-1daf-4de1-b79b-e64b3d6cec19
19212024-11-14T06:32:00.917ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = eb9bb663-1daf-4de1-b79b-e64b3d6cec19 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
19222024-11-14T06:32:00.917ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = eb9bb663-1daf-4de1-b79b-e64b3d6cec19 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
19232024-11-14T06:32:00.918ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = eb9bb663-1daf-4de1-b79b-e64b3d6cec19 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
19242024-11-14T06:32:00.918ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = eb9bb663-1daf-4de1-b79b-e64b3d6cec19 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
19252024-11-14T06:32:00.920ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = eb9bb663-1daf-4de1-b79b-e64b3d6cec19 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
19262024-11-14T06:32:00.920ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = eb9bb663-1daf-4de1-b79b-e64b3d6cec19 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
19272024-11-14T06:32:00.921ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = eb9bb663-1daf-4de1-b79b-e64b3d6cec19 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
19282024-11-14T06:32:00.924ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) }, key: 7978c97d-b581-4db3-bff9-bea13b3ed4db, lookup_type: ById(7978c97d-b581-4db3-bff9-bea13b3ed4db) }, key: dc849cad-a863-4ceb-a084-716be6d12072, lookup_type: ById(dc849cad-a863-4ceb-a084-716be6d12072) } result = Ok(()) saga_id = eb9bb663-1daf-4de1-b79b-e64b3d6cec19 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
19292024-11-14T06:32:00.924ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = eb9bb663-1daf-4de1-b79b-e64b3d6cec19 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
19302024-11-14T06:32:00.924ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = eb9bb663-1daf-4de1-b79b-e64b3d6cec19 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
19312024-11-14T06:32:00.929ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: cfc37030-f2c9-4bb4-a779-ab660b5b818c, time_created: 2024-11-14T06:31:40.216874Z, time_deleted: None, instance_id: dc849cad-a863-4ceb-a084-716be6d12072, sled_id: 27a56cb4-44ff-4d5b-931e-1c2c0642844d, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-11-14T06:32:00.742217Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-11-14T06:31:37.923158Z, gen: Generation(Generation(3)), propolis_id: Some(cfc37030-f2c9-4bb4-a779-ab660b5b818c), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = dc849cad-a863-4ceb-a084-716be6d12072 saga_id = eb9bb663-1daf-4de1-b79b-e64b3d6cec19 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(cfc37030-f2c9-4bb4-a779-ab660b5b818c (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-11-14T06:32:00.929206353Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
19322024-11-14T06:32:00.929ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788 saga_name = instance-update
19332024-11-14T06:32:00.931ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"dc849cad-a863-4ceb-a084-716be6d12072","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"cfc37030-f2c9-4bb4-a779-ab660b5b818c"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"dc849cad-a863-4ceb-a084-716be6d12072","lookup_type":{"ById":"dc849cad-a863-4ceb-a084-716be6d12072"},"parent":{"key":"7978c97d-b581-4db3-bff9-bea13b3ed4db","lookup_type":{"ById":"7978c97d-b581-4db3-bff9-bea13b3ed4db"},"parent":{"key":"95153e51-68aa-4bd4-8e65-b8164172811d","lookup_type":{"ById":"95153e51-68aa-4bd4-8e65-b8164172811d"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"3139ef5a-f5bc-4f72-b13a-d42da44d94e5"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"7978c97d-b581-4db3-bff9-bea13b3ed4db","ram_diff":1073741824},"destroy_active_vmm":"cfc37030-f2c9-4bb4-a779-ab660b5b818c","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2024-11-14T06:32:00.929206353Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788 saga_name = instance-update sec_id = 80190dc3-d884-49a0-b9a3-38d31e8c655a
19342024-11-14T06:32:00.931ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788 saga_name = instance-update
19352024-11-14T06:32:00.959ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788 saga_name = instance-update
19362024-11-14T06:32:00.959ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788 saga_name = instance-update sec_id = 80190dc3-d884-49a0-b9a3-38d31e8c655a
19372024-11-14T06:32:00.959ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 80190dc3-d884-49a0-b9a3-38d31e8c655a
19382024-11-14T06:32:00.959ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788
19392024-11-14T06:32:00.962ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 80190dc3-d884-49a0-b9a3-38d31e8c655a
19402024-11-14T06:32:00.962ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788
19412024-11-14T06:32:00.966ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 80190dc3-d884-49a0-b9a3-38d31e8c655a
19422024-11-14T06:32:00.966ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788
19432024-11-14T06:32:00.969ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 80190dc3-d884-49a0-b9a3-38d31e8c655a
19442024-11-14T06:32:00.969ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("dfdfe40a-9eee-4774-911a-edcc91ecfebb")) node_id = 0 saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788
19452024-11-14T06:32:00.972ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 80190dc3-d884-49a0-b9a3-38d31e8c655a
19462024-11-14T06:32:00.972ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788
19472024-11-14T06:32:00.975ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = dc849cad-a863-4ceb-a084-716be6d12072 parent_lock = UpdaterLock { updater_id: 3139ef5a-f5bc-4f72-b13a-d42da44d94e5, locked_gen: Generation(Generation(2)) } saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788 saga_name = instance-update
19482024-11-14T06:32:00.975ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788 saga_name = instance-update saga_node = BecomeUpdater
19492024-11-14T06:32:00.976ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788 saga_name = instance-update saga_node = BecomeUpdater
19502024-11-14T06:32:00.980ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36021 req_id = a9f53c2f-fbba-4cbe-ae70-03e62425ccc6 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/12?limit=100
19512024-11-14T06:32:00.980ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36021 req_id = a9f53c2f-fbba-4cbe-ae70-03e62425ccc6 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/12?limit=100
19522024-11-14T06:32:00.983ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2578 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36021 req_id = a9f53c2f-fbba-4cbe-ae70-03e62425ccc6 response_code = 200 uri = /nat/ipv4/changeset/12?limit=100
19532024-11-14T06:32:00.984ZDEBGnexus (SagaExecutor): inherited lock from 3139ef5a-f5bc-4f72-b13a-d42da44d94e5 to dfdfe40a-9eee-4774-911a-edcc91ecfebb actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = dc849cad-a863-4ceb-a084-716be6d12072 locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = 3139ef5a-f5bc-4f72-b13a-d42da44d94e5 saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788 saga_name = instance-update saga_node = BecomeUpdater updater_id = dfdfe40a-9eee-4774-911a-edcc91ecfebb
19542024-11-14T06:32:00.984ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = dc849cad-a863-4ceb-a084-716be6d12072 saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788 saga_name = instance-update
19552024-11-14T06:32:00.984ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 80190dc3-d884-49a0-b9a3-38d31e8c655a
19562024-11-14T06:32:00.984ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("dfdfe40a-9eee-4774-911a-edcc91ecfebb")}) node_id = 1 saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788
19572024-11-14T06:32:00.988ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 80190dc3-d884-49a0-b9a3-38d31e8c655a
19582024-11-14T06:32:00.988ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788
19592024-11-14T06:32:00.991ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 80190dc3-d884-49a0-b9a3-38d31e8c655a
19602024-11-14T06:32:00.991ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788
19612024-11-14T06:32:00.994ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 80190dc3-d884-49a0-b9a3-38d31e8c655a
19622024-11-14T06:32:00.994ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788
19632024-11-14T06:32:00.997ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = dc849cad-a863-4ceb-a084-716be6d12072 saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788 saga_name = instance-update
19642024-11-14T06:32:00.999ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = dc849cad-a863-4ceb-a084-716be6d12072
19652024-11-14T06:32:00.999ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788 saga_name = instance-update saga_node = UpdateNetworkConfig
19662024-11-14T06:32:00.999ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788 saga_name = instance-update saga_node = UpdateNetworkConfig
19672024-11-14T06:32:01.004ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788 saga_name = instance-update saga_node = UpdateNetworkConfig
19682024-11-14T06:32:01.005ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788 saga_name = instance-update saga_node = UpdateNetworkConfig
19692024-11-14T06:32:01.009ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
19702024-11-14T06:32:01.009ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788 saga_name = instance-update saga_node = UpdateNetworkConfig
19712024-11-14T06:32:01.010ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788 saga_name = instance-update saga_node = UpdateNetworkConfig
19722024-11-14T06:32:01.012ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
19732024-11-14T06:32:01.012ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
19742024-11-14T06:32:01.012ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
19752024-11-14T06:32:01.013ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
19762024-11-14T06:32:01.015ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
19772024-11-14T06:32:01.015ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
19782024-11-14T06:32:01.015ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
19792024-11-14T06:32:01.021ZDEBGnexus: notifying dendrite of updates instance_id = Some(dc849cad-a863-4ceb-a084-716be6d12072 (instance)) switch = switch0
19802024-11-14T06:32:01.022ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1777, tv_nsec: 580334846 } })
19812024-11-14T06:32:01.022ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1131
19822024-11-14T06:32:01.052ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
19832024-11-14T06:32:01.052ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19842024-11-14T06:32:01.052ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f93ebf2d-9d90-412c-98b3-a33c8fb9285b", "content-length": "26", "date": "Thu, 14 Nov 2024 06:32:01 GMT"} })
19852024-11-14T06:32:01.052ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19862024-11-14T06:32:01.053ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19872024-11-14T06:32:01.083ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
19882024-11-14T06:32:01.083ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f00bfe4-5db0-4b21-b9cc-5c51422f9377", "content-length": "4", "date": "Thu, 14 Nov 2024 06:32:00 GMT"} })
19892024-11-14T06:32:01.083ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 80190dc3-d884-49a0-b9a3-38d31e8c655a
19902024-11-14T06:32:01.084ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788
19912024-11-14T06:32:01.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 0592b6d2-274b-49c6-ba3c-63959033f213 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
19922024-11-14T06:32:01.089ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 0592b6d2-274b-49c6-ba3c-63959033f213 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
19932024-11-14T06:32:01.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1650 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 0592b6d2-274b-49c6-ba3c-63959033f213 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
19942024-11-14T06:32:01.091ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 80190dc3-d884-49a0-b9a3-38d31e8c655a
19952024-11-14T06:32:01.091ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788
19962024-11-14T06:32:01.100ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
19972024-11-14T06:32:01.100ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
19982024-11-14T06:32:01.122ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = dc849cad-a863-4ceb-a084-716be6d12072 records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-11-14T06:32:01.103570Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 7978c97d-b581-4db3-bff9-bea13b3ed4db, time_modified: Some(2024-11-14T06:32:01.103570Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 95153e51-68aa-4bd4-8e65-b8164172811d, time_modified: Some(2024-11-14T06:32:01.103570Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788 saga_name = instance-update
19992024-11-14T06:32:01.122ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 80190dc3-d884-49a0-b9a3-38d31e8c655a
20002024-11-14T06:32:01.122ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788
20012024-11-14T06:32:01.127ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 80190dc3-d884-49a0-b9a3-38d31e8c655a
20022024-11-14T06:32:01.127ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788
20032024-11-14T06:32:01.133ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = dc849cad-a863-4ceb-a084-716be6d12072 saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788 saga_name = instance-update
20042024-11-14T06:32:01.133ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788 saga_name = instance-update saga_node = UnassignOximeterProducer
20052024-11-14T06:32:01.133ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788 saga_name = instance-update saga_node = UnassignOximeterProducer
20062024-11-14T06:32:01.142ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6 producer_id = dc849cad-a863-4ceb-a084-716be6d12072 saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788 saga_name = instance-update
20072024-11-14T06:32:01.142ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788 saga_name = instance-update saga_node = UnassignOximeterProducer
20082024-11-14T06:32:01.142ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788 saga_name = instance-update saga_node = UnassignOximeterProducer
20092024-11-14T06:32:01.180ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = dc849cad-a863-4ceb-a084-716be6d12072 saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788 saga_name = instance-update
20102024-11-14T06:32:01.183ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = dc849cad-a863-4ceb-a084-716be6d12072 saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/dc849cad-a863-4ceb-a084-716be6d12072
20112024-11-14T06:32:01.201ZDEBGnexus (SagaExecutor): client response oximeter-collector = dc849cad-a863-4ceb-a084-716be6d12072 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/dc849cad-a863-4ceb-a084-716be6d12072", status: 204, headers: {"x-request-id": "a841dadf-5501-408a-8c86-57a04ac90a6f", "date": "Thu, 14 Nov 2024 06:32:01 GMT"} }) saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788 saga_name = instance-update
20122024-11-14T06:32:01.201ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6 producer_id = dc849cad-a863-4ceb-a084-716be6d12072 saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788 saga_name = instance-update
20132024-11-14T06:32:01.202ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 80190dc3-d884-49a0-b9a3-38d31e8c655a
20142024-11-14T06:32:01.202ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788
20152024-11-14T06:32:01.212ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 80190dc3-d884-49a0-b9a3-38d31e8c655a
20162024-11-14T06:32:01.212ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788
20172024-11-14T06:32:01.223ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = dc849cad-a863-4ceb-a084-716be6d12072 lock = UpdaterLock { updater_id: dfdfe40a-9eee-4774-911a-edcc91ecfebb, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-11-14T06:32:00.929206353Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788 saga_name = instance-update
20182024-11-14T06:32:01.223ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788 saga_name = instance-update saga_node = CommitInstanceUpdates
20192024-11-14T06:32:01.223ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788 saga_name = instance-update saga_node = CommitInstanceUpdates
20202024-11-14T06:32:01.274ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = dc849cad-a863-4ceb-a084-716be6d12072 new_runtime = InstanceRuntimeState { time_updated: 2024-11-14T06:32:00.929206353Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788 saga_name = instance-update
20212024-11-14T06:32:01.274ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 80190dc3-d884-49a0-b9a3-38d31e8c655a
20222024-11-14T06:32:01.274ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788
20232024-11-14T06:32:01.274ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Signaled
20242024-11-14T06:32:01.274ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Signaled
20252024-11-14T06:32:01.274ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20262024-11-14T06:32:01.274ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
20272024-11-14T06:32:01.274ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20282024-11-14T06:32:01.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20292024-11-14T06:32:01.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20302024-11-14T06:32:01.276ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20312024-11-14T06:32:01.278ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
20322024-11-14T06:32:01.278ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20332024-11-14T06:32:01.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20342024-11-14T06:32:01.280ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20352024-11-14T06:32:01.280ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 80190dc3-d884-49a0-b9a3-38d31e8c655a
20362024-11-14T06:32:01.280ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788
20372024-11-14T06:32:01.281ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
20382024-11-14T06:32:01.282ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20392024-11-14T06:32:01.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20402024-11-14T06:32:01.285ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 80190dc3-d884-49a0-b9a3-38d31e8c655a
20412024-11-14T06:32:01.285ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("dc849cad-a863-4ceb-a084-716be6d12072"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("cfc37030-f2c9-4bb4-a779-ab660b5b818c")}) node_id = 7 saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788
20422024-11-14T06:32:01.294ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 80190dc3-d884-49a0-b9a3-38d31e8c655a
20432024-11-14T06:32:01.294ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788
20442024-11-14T06:32:01.302ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 80190dc3-d884-49a0-b9a3-38d31e8c655a
20452024-11-14T06:32:01.302ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788
20462024-11-14T06:32:01.309ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 80190dc3-d884-49a0-b9a3-38d31e8c655a
20472024-11-14T06:32:01.309ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788
20482024-11-14T06:32:01.316ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = dc849cad-a863-4ceb-a084-716be6d12072 propolis_id = cfc37030-f2c9-4bb4-a779-ab660b5b818c saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788 saga_name = instance-update
20492024-11-14T06:32:01.316ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788 saga_name = instance-update saga_node = ReleaseSledResources
20502024-11-14T06:32:01.316ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788 saga_name = instance-update saga_node = ReleaseSledResources
20512024-11-14T06:32:01.322ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 80190dc3-d884-49a0-b9a3-38d31e8c655a
20522024-11-14T06:32:01.322ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788
20532024-11-14T06:32:01.325ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 80190dc3-d884-49a0-b9a3-38d31e8c655a
20542024-11-14T06:32:01.325ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788
20552024-11-14T06:32:01.328ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = dc849cad-a863-4ceb-a084-716be6d12072 propolis_id = cfc37030-f2c9-4bb4-a779-ab660b5b818c saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788 saga_name = instance-update
20562024-11-14T06:32:01.329ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788 saga_name = instance-update saga_node = MarkVmmDeleted
20572024-11-14T06:32:01.329ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788 saga_name = instance-update saga_node = MarkVmmDeleted
20582024-11-14T06:32:01.339ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 80190dc3-d884-49a0-b9a3-38d31e8c655a
20592024-11-14T06:32:01.340ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788
20602024-11-14T06:32:01.343ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 80190dc3-d884-49a0-b9a3-38d31e8c655a
20612024-11-14T06:32:01.343ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788
20622024-11-14T06:32:01.362ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20632024-11-14T06:32:01.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20642024-11-14T06:32:01.369ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
20652024-11-14T06:32:01.369ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
20662024-11-14T06:32:01.369ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "5cbcf5f4-741f-456b-8ba7-e6f44ca6b9b2", "content-length": "372", "date": "Thu, 14 Nov 2024 06:32:01 GMT"} })
20672024-11-14T06:32:01.369ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20682024-11-14T06:32:01.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20692024-11-14T06:32:01.372ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 80190dc3-d884-49a0-b9a3-38d31e8c655a
20702024-11-14T06:32:01.372ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788
20712024-11-14T06:32:01.376ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 80190dc3-d884-49a0-b9a3-38d31e8c655a
20722024-11-14T06:32:01.376ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788
20732024-11-14T06:32:01.377ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20742024-11-14T06:32:01.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20752024-11-14T06:32:01.379ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20762024-11-14T06:32:01.379ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788 saga_name = instance-update saga_node = ChainSuccessorSaga
20772024-11-14T06:32:01.380ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788 saga_name = instance-update saga_node = ChainSuccessorSaga
20782024-11-14T06:32:01.381ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20792024-11-14T06:32:01.381ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20802024-11-14T06:32:01.381ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788 saga_name = instance-update saga_node = ChainSuccessorSaga
20812024-11-14T06:32:01.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20822024-11-14T06:32:01.381ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788 saga_name = instance-update saga_node = ChainSuccessorSaga
20832024-11-14T06:32:01.382ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20842024-11-14T06:32:01.382ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788 saga_name = instance-update saga_node = ChainSuccessorSaga
20852024-11-14T06:32:01.383ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788 saga_name = instance-update saga_node = ChainSuccessorSaga
20862024-11-14T06:32:01.383ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
20872024-11-14T06:32:01.383ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
20882024-11-14T06:32:01.384ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ff25f4b5-ed96-4eb9-b9ac-cd99e51c5faa", "date": "Thu, 14 Nov 2024 06:32:01 GMT"} })
20892024-11-14T06:32:01.384ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20902024-11-14T06:32:01.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20912024-11-14T06:32:01.384ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788 saga_name = instance-update saga_node = ChainSuccessorSaga
20922024-11-14T06:32:01.384ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20932024-11-14T06:32:01.384ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20942024-11-14T06:32:01.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20952024-11-14T06:32:01.385ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20962024-11-14T06:32:01.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20972024-11-14T06:32:01.387ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) }, key: 7978c97d-b581-4db3-bff9-bea13b3ed4db, lookup_type: ById(7978c97d-b581-4db3-bff9-bea13b3ed4db) }, key: dc849cad-a863-4ceb-a084-716be6d12072, lookup_type: ById(dc849cad-a863-4ceb-a084-716be6d12072) } result = Ok(()) saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788 saga_name = instance-update saga_node = ChainSuccessorSaga
20982024-11-14T06:32:01.387ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788 saga_name = instance-update saga_node = ChainSuccessorSaga
20992024-11-14T06:32:01.387ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788 saga_name = instance-update saga_node = ChainSuccessorSaga
21002024-11-14T06:32:01.388ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21012024-11-14T06:32:01.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21022024-11-14T06:32:01.392ZDEBGnexus (SagaExecutor): instance update: instance will not reincarnate auto_restart_config = InstanceAutoRestart { policy: None, cooldown: None } instance_id = dc849cad-a863-4ceb-a084-716be6d12072 karmic_state = WillReincarnate needs_reincarnation = false saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788 saga_name = instance-update
21032024-11-14T06:32:01.392ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 80190dc3-d884-49a0-b9a3-38d31e8c655a
21042024-11-14T06:32:01.392ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788
21052024-11-14T06:32:01.392ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
21062024-11-14T06:32:01.392ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
21072024-11-14T06:32:01.393ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "617b7bfa-67de-4d96-9434-0fd84f3095d8", "date": "Thu, 14 Nov 2024 06:32:00 GMT"} })
21082024-11-14T06:32:01.395ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 120.718937ms iteration = 27 status = {}
21092024-11-14T06:32:01.396ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 80190dc3-d884-49a0-b9a3-38d31e8c655a
21102024-11-14T06:32:01.396ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788
21112024-11-14T06:32:01.417ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
21122024-11-14T06:32:01.417ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "37047881-0a38-4bcc-96ec-dd2c1cae5ea7", "content-length": "691", "date": "Thu, 14 Nov 2024 06:32:00 GMT"} })
21132024-11-14T06:32:01.418ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
21142024-11-14T06:32:01.418ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
21152024-11-14T06:32:01.418ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
21162024-11-14T06:32:01.420ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 145.658191ms iteration = 27 status = {}
21172024-11-14T06:32:01.420ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 80190dc3-d884-49a0-b9a3-38d31e8c655a
21182024-11-14T06:32:01.420ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788
21192024-11-14T06:32:01.423ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788 sec_id = 80190dc3-d884-49a0-b9a3-38d31e8c655a
21202024-11-14T06:32:01.423ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788
21212024-11-14T06:32:01.466ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788 saga_name = instance-update sec_id = 80190dc3-d884-49a0-b9a3-38d31e8c655a
21222024-11-14T06:32:01.466ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788 saga_name = instance-update saga_result = SagaResult { saga_id: 5900ad8c-10d2-44fe-b15e-1fe12ae0d788, saga_log: SagaLog { saga_id: 5900ad8c-10d2-44fe-b15e-1fe12ae0d788, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("dfdfe40a-9eee-4774-911a-edcc91ecfebb")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("dfdfe40a-9eee-4774-911a-edcc91ecfebb")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("dc849cad-a863-4ceb-a084-716be6d12072"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("cfc37030-f2c9-4bb4-a779-ab660b5b818c")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("dc849cad-a863-4ceb-a084-716be6d12072"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("cfc37030-f2c9-4bb4-a779-ab660b5b818c")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("dfdfe40a-9eee-4774-911a-edcc91ecfebb"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("dfdfe40a-9eee-4774-911a-edcc91ecfebb")}} }) }
21232024-11-14T06:32:01.466ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = 5900ad8c-10d2-44fe-b15e-1fe12ae0d788 instance_id = dc849cad-a863-4ceb-a084-716be6d12072 saga_id = eb9bb663-1daf-4de1-b79b-e64b3d6cec19 saga_name = start-instance-update
21242024-11-14T06:32:01.466ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 80190dc3-d884-49a0-b9a3-38d31e8c655a
21252024-11-14T06:32:01.466ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = eb9bb663-1daf-4de1-b79b-e64b3d6cec19
21262024-11-14T06:32:01.470ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 80190dc3-d884-49a0-b9a3-38d31e8c655a
21272024-11-14T06:32:01.470ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = eb9bb663-1daf-4de1-b79b-e64b3d6cec19
21282024-11-14T06:32:01.474ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 80190dc3-d884-49a0-b9a3-38d31e8c655a
21292024-11-14T06:32:01.474ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = eb9bb663-1daf-4de1-b79b-e64b3d6cec19
21302024-11-14T06:32:01.477ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = eb9bb663-1daf-4de1-b79b-e64b3d6cec19 sec_id = 80190dc3-d884-49a0-b9a3-38d31e8c655a
21312024-11-14T06:32:01.477ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = eb9bb663-1daf-4de1-b79b-e64b3d6cec19
21322024-11-14T06:32:01.483ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = eb9bb663-1daf-4de1-b79b-e64b3d6cec19 saga_name = start-instance-update sec_id = 80190dc3-d884-49a0-b9a3-38d31e8c655a
21332024-11-14T06:32:01.483ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = eb9bb663-1daf-4de1-b79b-e64b3d6cec19 saga_name = start-instance-update saga_result = SagaResult { saga_id: eb9bb663-1daf-4de1-b79b-e64b3d6cec19, saga_log: SagaLog { saga_id: eb9bb663-1daf-4de1-b79b-e64b3d6cec19, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("3139ef5a-f5bc-4f72-b13a-d42da44d94e5")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("3139ef5a-f5bc-4f72-b13a-d42da44d94e5")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("3139ef5a-f5bc-4f72-b13a-d42da44d94e5"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("3139ef5a-f5bc-4f72-b13a-d42da44d94e5")}} }) }
21342024-11-14T06:32:01.983ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36021 req_id = be0a1a93-3482-41c0-bece-d7b21cb2db61 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/12?limit=100
21352024-11-14T06:32:01.984ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36021 req_id = be0a1a93-3482-41c0-bece-d7b21cb2db61 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/12?limit=100
21362024-11-14T06:32:01.986ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2839 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36021 req_id = be0a1a93-3482-41c0-bece-d7b21cb2db61 response_code = 200 uri = /nat/ipv4/changeset/12?limit=100
21372024-11-14T06:32:02.113ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 04c48489-5204-4033-90af-8d51448928bf roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
21382024-11-14T06:32:02.113ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 04c48489-5204-4033-90af-8d51448928bf resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
21392024-11-14T06:32:02.115ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2371 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 04c48489-5204-4033-90af-8d51448928bf response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
21402024-11-14T06:32:03.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 674e74e9-9a61-48c7-aa6f-23e702935ffa roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
21412024-11-14T06:32:03.137ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 674e74e9-9a61-48c7-aa6f-23e702935ffa resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
21422024-11-14T06:32:03.139ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1952 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 674e74e9-9a61-48c7-aa6f-23e702935ffa response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
21432024-11-14T06:32:04.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 779610fc-484a-4c82-be47-4ab83e2249c0 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
21442024-11-14T06:32:04.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 779610fc-484a-4c82-be47-4ab83e2249c0 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
21452024-11-14T06:32:04.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2404 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 779610fc-484a-4c82-be47-4ab83e2249c0 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
21462024-11-14T06:32:05.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = c7eee6cc-eac0-4725-9551-3b9700133297 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
21472024-11-14T06:32:05.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = c7eee6cc-eac0-4725-9551-3b9700133297 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
21482024-11-14T06:32:05.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2437 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = c7eee6cc-eac0-4725-9551-3b9700133297 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
21492024-11-14T06:32:06.213ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 19d7ae71-a60c-42e1-8789-62cef808b471 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
21502024-11-14T06:32:06.213ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 19d7ae71-a60c-42e1-8789-62cef808b471 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
21512024-11-14T06:32:06.215ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2443 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 19d7ae71-a60c-42e1-8789-62cef808b471 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
21522024-11-14T06:32:07.235ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 61f02825-6b98-4916-a36a-df2fe37c00d9 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
21532024-11-14T06:32:07.235ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 61f02825-6b98-4916-a36a-df2fe37c00d9 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
21542024-11-14T06:32:07.238ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3027 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 61f02825-6b98-4916-a36a-df2fe37c00d9 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
21552024-11-14T06:32:07.606ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 729 local_addr = [fd00:1122:3344:101::c]:60882 method = GET remote_addr = [fd00:1122:3344:101::d]:64488 req_id = 7e7e6749-b79c-4cd9-9cf2-7340d2a70aba response_code = 200 uri = /80190dc3-d884-49a0-b9a3-38d31e8c655a
21562024-11-14T06:32:08.258ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = fd739ddb-7f06-4195-b81e-377bbc785a25 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
21572024-11-14T06:32:08.258ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = fd739ddb-7f06-4195-b81e-377bbc785a25 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
21582024-11-14T06:32:08.260ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2266 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = fd739ddb-7f06-4195-b81e-377bbc785a25 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
21592024-11-14T06:32:09.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 12753b25-597c-471b-8bad-b26e3e05eedd roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
21602024-11-14T06:32:09.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 12753b25-597c-471b-8bad-b26e3e05eedd resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
21612024-11-14T06:32:09.283ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2352 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 12753b25-597c-471b-8bad-b26e3e05eedd response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
21622024-11-14T06:32:09.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
21632024-11-14T06:32:09.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
21642024-11-14T06:32:09.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21652024-11-14T06:32:09.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21662024-11-14T06:32:09.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21672024-11-14T06:32:09.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21682024-11-14T06:32:09.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21692024-11-14T06:32:09.576ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21702024-11-14T06:32:09.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21712024-11-14T06:32:09.578ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21722024-11-14T06:32:09.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21732024-11-14T06:32:09.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21742024-11-14T06:32:09.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21752024-11-14T06:32:09.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21762024-11-14T06:32:09.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21772024-11-14T06:32:09.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
21782024-11-14T06:32:09.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21792024-11-14T06:32:09.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21802024-11-14T06:32:09.592ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
21812024-11-14T06:32:09.592ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.428354ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
21822024-11-14T06:32:09.605ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.556987ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21832024-11-14T06:32:10.305ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f3b62934-c3d5-4fa7-8594-a45aba1e0e9f roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
21842024-11-14T06:32:10.305ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f3b62934-c3d5-4fa7-8594-a45aba1e0e9f resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
21852024-11-14T06:32:10.307ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2583 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f3b62934-c3d5-4fa7-8594-a45aba1e0e9f response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
21862024-11-14T06:32:11.328ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 419cdad8-27a3-4c64-969e-7435b0210897 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
21872024-11-14T06:32:11.329ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 419cdad8-27a3-4c64-969e-7435b0210897 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
21882024-11-14T06:32:11.331ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2635 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 419cdad8-27a3-4c64-969e-7435b0210897 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
21892024-11-14T06:32:12.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 688fe764-9be8-4747-9a7b-15947a78ce89 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
21902024-11-14T06:32:12.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 688fe764-9be8-4747-9a7b-15947a78ce89 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
21912024-11-14T06:32:12.354ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1924 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 688fe764-9be8-4747-9a7b-15947a78ce89 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
21922024-11-14T06:32:13.375ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f70f9201-c3a0-479d-bb67-ea487e890064 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
21932024-11-14T06:32:13.375ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f70f9201-c3a0-479d-bb67-ea487e890064 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
21942024-11-14T06:32:13.377ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2584 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f70f9201-c3a0-479d-bb67-ea487e890064 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
21952024-11-14T06:32:14.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = b80c4370-f26f-4ff2-9dfc-3591113b9d67 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
21962024-11-14T06:32:14.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = b80c4370-f26f-4ff2-9dfc-3591113b9d67 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
21972024-11-14T06:32:14.401ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2225 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = b80c4370-f26f-4ff2-9dfc-3591113b9d67 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
21982024-11-14T06:32:15.422ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 37d7ea4a-021b-41cd-a62a-e0bbba93a7e8 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
21992024-11-14T06:32:15.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 37d7ea4a-021b-41cd-a62a-e0bbba93a7e8 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
22002024-11-14T06:32:15.424ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2228 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 37d7ea4a-021b-41cd-a62a-e0bbba93a7e8 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
22012024-11-14T06:32:16.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = a6cea83e-6353-4c0a-88e8-67024b0afe38 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
22022024-11-14T06:32:16.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = a6cea83e-6353-4c0a-88e8-67024b0afe38 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
22032024-11-14T06:32:16.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2780 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = a6cea83e-6353-4c0a-88e8-67024b0afe38 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
22042024-11-14T06:32:17.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f9a9629b-af55-452c-addd-4d85005406be roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
22052024-11-14T06:32:17.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f9a9629b-af55-452c-addd-4d85005406be resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
22062024-11-14T06:32:17.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1791 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f9a9629b-af55-452c-addd-4d85005406be response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
22072024-11-14T06:32:18.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 6f36466c-c77c-4616-9086-9f53ce7ecc2a roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
22082024-11-14T06:32:18.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 6f36466c-c77c-4616-9086-9f53ce7ecc2a resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
22092024-11-14T06:32:18.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2162 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 6f36466c-c77c-4616-9086-9f53ce7ecc2a response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
22102024-11-14T06:32:19.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 21b1e688-56f2-4e4b-82eb-bb78e30bc6b6 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
22112024-11-14T06:32:19.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 21b1e688-56f2-4e4b-82eb-bb78e30bc6b6 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
22122024-11-14T06:32:19.515ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1940 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 21b1e688-56f2-4e4b-82eb-bb78e30bc6b6 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
22132024-11-14T06:32:19.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
22142024-11-14T06:32:19.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
22152024-11-14T06:32:19.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22162024-11-14T06:32:19.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22172024-11-14T06:32:19.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22182024-11-14T06:32:19.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22192024-11-14T06:32:19.577ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22202024-11-14T06:32:19.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22212024-11-14T06:32:19.579ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.171596ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
22222024-11-14T06:32:19.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22232024-11-14T06:32:19.582ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
22242024-11-14T06:32:19.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22252024-11-14T06:32:19.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22262024-11-14T06:32:19.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22272024-11-14T06:32:19.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22282024-11-14T06:32:19.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22292024-11-14T06:32:19.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
22302024-11-14T06:32:19.589ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22312024-11-14T06:32:19.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22322024-11-14T06:32:19.600ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
22332024-11-14T06:32:19.600ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.054765ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
22342024-11-14T06:32:20.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 17090cfa-94be-4bd6-928d-bebb7c04c6de roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
22352024-11-14T06:32:20.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 17090cfa-94be-4bd6-928d-bebb7c04c6de resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
22362024-11-14T06:32:20.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2494 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 17090cfa-94be-4bd6-928d-bebb7c04c6de response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
22372024-11-14T06:32:21.559ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = a3b9e284-1da8-4243-9e7a-0e52b789dabb roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
22382024-11-14T06:32:21.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = a3b9e284-1da8-4243-9e7a-0e52b789dabb resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
22392024-11-14T06:32:21.561ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2291 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = a3b9e284-1da8-4243-9e7a-0e52b789dabb response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
22402024-11-14T06:32:22.583ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 6cc767f7-b232-48d3-980b-40e2ce9ff06f roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
22412024-11-14T06:32:22.583ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 6cc767f7-b232-48d3-980b-40e2ce9ff06f resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
22422024-11-14T06:32:22.585ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2281 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 6cc767f7-b232-48d3-980b-40e2ce9ff06f response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
22432024-11-14T06:32:22.611ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1173 local_addr = [fd00:1122:3344:101::c]:60882 method = GET remote_addr = [fd00:1122:3344:101::d]:64488 req_id = 49a6c8a0-10c5-4613-9a04-9d354dfaa1d0 response_code = 200 uri = /80190dc3-d884-49a0-b9a3-38d31e8c655a
22442024-11-14T06:32:23.606ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 8a447b2c-0bb1-424b-b79b-35bee441f523 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
22452024-11-14T06:32:23.606ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 8a447b2c-0bb1-424b-b79b-35bee441f523 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
22462024-11-14T06:32:23.608ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2220 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 8a447b2c-0bb1-424b-b79b-35bee441f523 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
22472024-11-14T06:32:24.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f8a5cc17-8b3d-437e-b14f-4aab0a7ddfac roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
22482024-11-14T06:32:24.629ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f8a5cc17-8b3d-437e-b14f-4aab0a7ddfac resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
22492024-11-14T06:32:24.631ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2736 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f8a5cc17-8b3d-437e-b14f-4aab0a7ddfac response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
22502024-11-14T06:32:25.653ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = d6682d7f-618c-466f-9bbb-d1c11dfedbae roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
22512024-11-14T06:32:25.653ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = d6682d7f-618c-466f-9bbb-d1c11dfedbae resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
22522024-11-14T06:32:25.655ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2183 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = d6682d7f-618c-466f-9bbb-d1c11dfedbae response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
22532024-11-14T06:32:26.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 5f068934-3559-48f4-b9a1-846560ff7da1 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
22542024-11-14T06:32:26.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 5f068934-3559-48f4-b9a1-846560ff7da1 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
22552024-11-14T06:32:26.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2341 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 5f068934-3559-48f4-b9a1-846560ff7da1 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
22562024-11-14T06:32:27.701ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 931c3a24-c692-478f-a513-36332b5d0ae0 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
22572024-11-14T06:32:27.701ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 931c3a24-c692-478f-a513-36332b5d0ae0 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
22582024-11-14T06:32:27.703ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2576 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 931c3a24-c692-478f-a513-36332b5d0ae0 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
22592024-11-14T06:32:28.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 4b900ac0-473a-48ea-ac52-efdb643d1f52 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
22602024-11-14T06:32:28.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 4b900ac0-473a-48ea-ac52-efdb643d1f52 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
22612024-11-14T06:32:28.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2349 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 4b900ac0-473a-48ea-ac52-efdb643d1f52 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
22622024-11-14T06:32:29.574ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
22632024-11-14T06:32:29.574ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
22642024-11-14T06:32:29.574ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22652024-11-14T06:32:29.574ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
22662024-11-14T06:32:29.574ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
22672024-11-14T06:32:29.574ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22682024-11-14T06:32:29.574ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
22692024-11-14T06:32:29.574ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
22702024-11-14T06:32:29.574ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22712024-11-14T06:32:29.574ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
22722024-11-14T06:32:29.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
22732024-11-14T06:32:29.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22742024-11-14T06:32:29.574ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
22752024-11-14T06:32:29.574ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
22762024-11-14T06:32:29.574ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
22772024-11-14T06:32:29.574ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
22782024-11-14T06:32:29.574ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22792024-11-14T06:32:29.574ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
22802024-11-14T06:32:29.574ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
22812024-11-14T06:32:29.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
22822024-11-14T06:32:29.574ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 1d98d624-72d4-4466-8fe7-990461a3f886
22832024-11-14T06:32:29.574ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
22842024-11-14T06:32:29.574ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.63\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"1d98d624-72d4-4466-8fe7-990461a3f886"}
22852024-11-14T06:32:29.574ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
22862024-11-14T06:32:29.574ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
22872024-11-14T06:32:29.574ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
22882024-11-14T06:32:29.574ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
22892024-11-14T06:32:29.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
22902024-11-14T06:32:29.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22912024-11-14T06:32:29.574ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
22922024-11-14T06:32:29.574ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
22932024-11-14T06:32:29.574ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 06:22:29.574451536 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
22942024-11-14T06:32:29.574ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
22952024-11-14T06:32:29.574ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
22962024-11-14T06:32:29.574ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
22972024-11-14T06:32:29.574ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22982024-11-14T06:32:29.574ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
22992024-11-14T06:32:29.574ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
23002024-11-14T06:32:29.574ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
23012024-11-14T06:32:29.574ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23022024-11-14T06:32:29.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
23032024-11-14T06:32:29.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
23042024-11-14T06:32:29.574ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
23052024-11-14T06:32:29.574ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
23062024-11-14T06:32:29.574ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
23072024-11-14T06:32:29.574ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
23082024-11-14T06:32:29.574ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
23092024-11-14T06:32:29.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23102024-11-14T06:32:29.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
23112024-11-14T06:32:29.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23122024-11-14T06:32:29.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
23132024-11-14T06:32:29.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23142024-11-14T06:32:29.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23152024-11-14T06:32:29.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23162024-11-14T06:32:29.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23172024-11-14T06:32:29.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
23182024-11-14T06:32:29.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
23192024-11-14T06:32:29.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
23202024-11-14T06:32:29.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23212024-11-14T06:32:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23222024-11-14T06:32:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23232024-11-14T06:32:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
23242024-11-14T06:32:29.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
23252024-11-14T06:32:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
23262024-11-14T06:32:29.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
23272024-11-14T06:32:29.575ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
23282024-11-14T06:32:29.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
23292024-11-14T06:32:29.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
23302024-11-14T06:32:29.575ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
23312024-11-14T06:32:29.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
23322024-11-14T06:32:29.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
23332024-11-14T06:32:29.575ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
23342024-11-14T06:32:29.575ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
23352024-11-14T06:32:29.575ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23362024-11-14T06:32:29.575ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
23372024-11-14T06:32:29.575ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
23382024-11-14T06:32:29.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
23392024-11-14T06:32:29.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
23402024-11-14T06:32:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
23412024-11-14T06:32:29.575ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("720ac48b-8596-4763-a661-482d124c0a16.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f40de7f6-4bc1-4578-baeb-b08e777b4bed.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f40de7f6-4bc1-4578-baeb-b08e777b4bed.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1806, tv_nsec: 133341323 } })
23422024-11-14T06:32:29.575ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("36c202a9-b541-4083-88f5-ff6483340b34.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("78c1624f-34e7-40fb-a468-bb6354445b73.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d40cb6d7-78a4-49d0-ae26-45907e21e06a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d40cb6d7-78a4-49d0-ae26-45907e21e06a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1806, tv_nsec: 133355593 } })
23432024-11-14T06:32:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23442024-11-14T06:32:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
23452024-11-14T06:32:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
23462024-11-14T06:32:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
23472024-11-14T06:32:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
23482024-11-14T06:32:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
23492024-11-14T06:32:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
23502024-11-14T06:32:29.575ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
23512024-11-14T06:32:29.575ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.465168ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
23522024-11-14T06:32:29.575ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
23532024-11-14T06:32:29.575ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.57018ms iteration = 14 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
23542024-11-14T06:32:29.581ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23552024-11-14T06:32:29.582ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23562024-11-14T06:32:29.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
23572024-11-14T06:32:29.584ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
23582024-11-14T06:32:29.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
23592024-11-14T06:32:29.586ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
23602024-11-14T06:32:29.586ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23612024-11-14T06:32:29.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23622024-11-14T06:32:29.591ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23632024-11-14T06:32:29.593ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23642024-11-14T06:32:29.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23652024-11-14T06:32:29.593ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 19.305929ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
23662024-11-14T06:32:29.593ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23672024-11-14T06:32:29.594ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
23682024-11-14T06:32:29.594ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23692024-11-14T06:32:29.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23702024-11-14T06:32:29.594ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1806, tv_nsec: 152527040 } })
23712024-11-14T06:32:29.594ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
23722024-11-14T06:32:29.596ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
23732024-11-14T06:32:29.597ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23742024-11-14T06:32:29.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23752024-11-14T06:32:29.598ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1806, tv_nsec: 156414633 } })
23762024-11-14T06:32:29.598ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23772024-11-14T06:32:29.598ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
23782024-11-14T06:32:29.600ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23792024-11-14T06:32:29.600ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 06:22:29.574451536 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
23802024-11-14T06:32:29.600ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 25.744209ms iteration = 14 status = {"expiration":"2024-11-14T06:22:29.574451536Z","pruned":[]}
23812024-11-14T06:32:29.600ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23822024-11-14T06:32:29.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23832024-11-14T06:32:29.601ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
23842024-11-14T06:32:29.601ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
23852024-11-14T06:32:29.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23862024-11-14T06:32:29.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
23872024-11-14T06:32:29.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23882024-11-14T06:32:29.603ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
23892024-11-14T06:32:29.603ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23902024-11-14T06:32:29.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23912024-11-14T06:32:29.603ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
23922024-11-14T06:32:29.603ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
23932024-11-14T06:32:29.603ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
23942024-11-14T06:32:29.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
23952024-11-14T06:32:29.606ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23962024-11-14T06:32:29.607ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 32.729779ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
23972024-11-14T06:32:29.608ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
23982024-11-14T06:32:29.608ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23992024-11-14T06:32:29.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24002024-11-14T06:32:29.610ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
24012024-11-14T06:32:29.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
24022024-11-14T06:32:29.611ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 36.356846ms iteration = 27 status = {"errors":[],"records_set_to_done":[]}
24032024-11-14T06:32:29.618ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24042024-11-14T06:32:29.620ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1806, tv_nsec: 178624596 } })
24052024-11-14T06:32:29.620ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24062024-11-14T06:32:29.620ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
24072024-11-14T06:32:29.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24082024-11-14T06:32:29.622ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
24092024-11-14T06:32:29.622ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 48.33377ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
24102024-11-14T06:32:29.623ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
24112024-11-14T06:32:29.624ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
24122024-11-14T06:32:29.624ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
24132024-11-14T06:32:29.624ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
24142024-11-14T06:32:29.624ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24152024-11-14T06:32:29.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24162024-11-14T06:32:29.625ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24172024-11-14T06:32:29.625ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24182024-11-14T06:32:29.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24192024-11-14T06:32:29.627ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24202024-11-14T06:32:29.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24212024-11-14T06:32:29.630ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
24222024-11-14T06:32:29.632ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 57.369588ms iteration = 27 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
24232024-11-14T06:32:29.632ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
24242024-11-14T06:32:29.632ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
24252024-11-14T06:32:29.632ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
24262024-11-14T06:32:29.632ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24272024-11-14T06:32:29.632ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24282024-11-14T06:32:29.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24292024-11-14T06:32:29.633ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24302024-11-14T06:32:29.635ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24312024-11-14T06:32:29.637ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
24322024-11-14T06:32:29.637ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24332024-11-14T06:32:29.637ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
24342024-11-14T06:32:29.637ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24352024-11-14T06:32:29.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24362024-11-14T06:32:29.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24372024-11-14T06:32:29.639ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24382024-11-14T06:32:29.640ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
24392024-11-14T06:32:29.640ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24402024-11-14T06:32:29.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24412024-11-14T06:32:29.643ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
24422024-11-14T06:32:29.643ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24432024-11-14T06:32:29.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24442024-11-14T06:32:29.643ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24452024-11-14T06:32:29.647ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
24462024-11-14T06:32:29.647ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24472024-11-14T06:32:29.647ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
24482024-11-14T06:32:29.647ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 30e11b92-f705-4c8e-bce7-d646f8ce00cf dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
24492024-11-14T06:32:29.647ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24502024-11-14T06:32:29.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24512024-11-14T06:32:29.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24522024-11-14T06:32:29.650ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24532024-11-14T06:32:29.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24542024-11-14T06:32:29.663ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
24552024-11-14T06:32:29.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
24562024-11-14T06:32:29.663ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
24572024-11-14T06:32:29.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
24582024-11-14T06:32:29.664ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
24592024-11-14T06:32:29.664ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
24602024-11-14T06:32:29.664ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 89.21452ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
24612024-11-14T06:32:29.665ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
24622024-11-14T06:32:29.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
24632024-11-14T06:32:29.666ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 92.41883ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
24642024-11-14T06:32:29.668ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 93.897228ms iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
24652024-11-14T06:32:29.671ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
24662024-11-14T06:32:29.671ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
24672024-11-14T06:32:29.671ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 97.579666ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
24682024-11-14T06:32:29.673ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 98.787119ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
24692024-11-14T06:32:29.674ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24702024-11-14T06:32:29.677ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24712024-11-14T06:32:29.677ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
24722024-11-14T06:32:29.677ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24732024-11-14T06:32:29.677ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24742024-11-14T06:32:29.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24752024-11-14T06:32:29.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24762024-11-14T06:32:29.680ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
24772024-11-14T06:32:29.680ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24782024-11-14T06:32:29.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24792024-11-14T06:32:29.682ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24802024-11-14T06:32:29.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24812024-11-14T06:32:29.685ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24822024-11-14T06:32:29.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24832024-11-14T06:32:29.685ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24842024-11-14T06:32:29.685ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
24852024-11-14T06:32:29.685ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
24862024-11-14T06:32:29.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24872024-11-14T06:32:29.689ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 115.544871ms iteration = 30 status = {"physical_disks_added":0}
24882024-11-14T06:32:29.692ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
24892024-11-14T06:32:29.692ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = c6d59938-b455-4e7b-9d17-0d6427a65b9c dns_zone_name = oxide.test found_so_far = 0 version = 2
24902024-11-14T06:32:29.692ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24912024-11-14T06:32:29.692ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24922024-11-14T06:32:29.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24932024-11-14T06:32:29.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24942024-11-14T06:32:29.693ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24952024-11-14T06:32:29.697ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
24962024-11-14T06:32:29.697ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24972024-11-14T06:32:29.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24982024-11-14T06:32:29.699ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
24992024-11-14T06:32:29.699ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 125.555918ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
25002024-11-14T06:32:29.707ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
25012024-11-14T06:32:29.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
25022024-11-14T06:32:29.716ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 141.28596ms iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
25032024-11-14T06:32:29.745ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
25042024-11-14T06:32:29.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 11ff5b2a-e8f1-4fc4-b2af-9614bb8d0d81 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
25052024-11-14T06:32:29.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 11ff5b2a-e8f1-4fc4-b2af-9614bb8d0d81 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
25062024-11-14T06:32:29.754ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
25072024-11-14T06:32:29.754ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25082024-11-14T06:32:29.754ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d08dac15-31a8-4725-8129-f341ad6e78e9", "content-length": "26", "date": "Thu, 14 Nov 2024 06:32:29 GMT"} })
25092024-11-14T06:32:29.754ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25102024-11-14T06:32:29.756ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
25112024-11-14T06:32:29.780ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
25122024-11-14T06:32:29.780ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25132024-11-14T06:32:29.780ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a45a4221-dea1-4e31-b800-e35a91defc2f", "content-length": "26", "date": "Thu, 14 Nov 2024 06:32:29 GMT"} })
25142024-11-14T06:32:29.780ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25152024-11-14T06:32:29.782ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
25162024-11-14T06:32:29.794ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25172024-11-14T06:32:29.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25182024-11-14T06:32:29.835ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
25192024-11-14T06:32:29.862ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
25202024-11-14T06:32:29.862ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
25212024-11-14T06:32:29.862ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a58e6168-3812-442c-993e-3e865d0b5d2f", "content-length": "372", "date": "Thu, 14 Nov 2024 06:32:29 GMT"} })
25222024-11-14T06:32:29.862ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25232024-11-14T06:32:29.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25242024-11-14T06:32:29.864ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25252024-11-14T06:32:29.866ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25262024-11-14T06:32:29.868ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 30e11b92-f705-4c8e-bce7-d646f8ce00cf dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
25272024-11-14T06:32:29.868ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
25282024-11-14T06:32:29.868ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-14 06:19:30.340423 UTC dns_group = internal generation = 1
25292024-11-14T06:32:29.868ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 293.831949ms iteration = 14 status = {"generation":1}
25302024-11-14T06:32:29.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 27a56cb4-44ff-4d5b-931e-1c2c0642844d, lookup_type: ById(27a56cb4-44ff-4d5b-931e-1c2c0642844d) } result = Ok(())
25312024-11-14T06:32:29.869ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25322024-11-14T06:32:29.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25332024-11-14T06:32:29.869ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
25342024-11-14T06:32:29.869ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25352024-11-14T06:32:29.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
25362024-11-14T06:32:29.871ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123691 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 11ff5b2a-e8f1-4fc4-b2af-9614bb8d0d81 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
25372024-11-14T06:32:29.872ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 298.69924ms iteration = 27 status = 0
25382024-11-14T06:32:29.908ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25392024-11-14T06:32:29.908ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25402024-11-14T06:32:29.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
25412024-11-14T06:32:29.911ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
25422024-11-14T06:32:29.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
25432024-11-14T06:32:29.912ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
25442024-11-14T06:32:29.912ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25452024-11-14T06:32:29.912ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
25462024-11-14T06:32:29.912ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
25472024-11-14T06:32:29.912ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 337.538603ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
25482024-11-14T06:32:29.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25492024-11-14T06:32:29.914ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25502024-11-14T06:32:29.914ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = c6d59938-b455-4e7b-9d17-0d6427a65b9c dns_zone_name = oxide.test found_so_far = 1 version = 2
25512024-11-14T06:32:29.914ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
25522024-11-14T06:32:29.914ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-14 06:19:31.616543 UTC dns_group = external generation = 2
25532024-11-14T06:32:29.914ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 339.757694ms iteration = 14 status = {"generation":2}
25542024-11-14T06:32:29.914ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
25552024-11-14T06:32:29.914ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
25562024-11-14T06:32:29.914ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f79dce35-04b4-4623-ab94-6726cdb65a46", "date": "Thu, 14 Nov 2024 06:32:29 GMT"} })
25572024-11-14T06:32:29.914ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25582024-11-14T06:32:29.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25592024-11-14T06:32:29.915ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
25602024-11-14T06:32:29.915ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25612024-11-14T06:32:29.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25622024-11-14T06:32:29.916ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T06:19:27.309503Z, time_modified: 2024-11-14T06:19:27.309503Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, db_silo: Silo { identity: SiloIdentity { id: 95153e51-68aa-4bd4-8e65-b8164172811d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T06:19:31.569300Z, time_modified: 2024-11-14T06:19:31.569300Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, db_silo: Silo { identity: SiloIdentity { id: 95153e51-68aa-4bd4-8e65-b8164172811d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T06:19:31.569300Z, time_modified: 2024-11-14T06:19:31.569300Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
25632024-11-14T06:32:29.916ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 342.173099ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"95153e51-68aa-4bd4-8e65-b8164172811d","tls_certs":["3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89"]}},"default_endpoint":{"silo_id":"95153e51-68aa-4bd4-8e65-b8164172811d","tls_certs":["3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
25642024-11-14T06:32:29.919ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25652024-11-14T06:32:29.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25662024-11-14T06:32:29.922ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25672024-11-14T06:32:29.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25682024-11-14T06:32:29.926ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
25692024-11-14T06:32:29.927ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
25702024-11-14T06:32:29.927ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
25712024-11-14T06:32:29.927ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "234cf600-b208-4e30-a36b-ea47509d980a", "date": "Thu, 14 Nov 2024 06:32:29 GMT"} })
25722024-11-14T06:32:29.928ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 353.869227ms iteration = 28 status = {}
25732024-11-14T06:32:29.936ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 zone_address = fd00:1122:3344:101::2
25742024-11-14T06:32:29.936ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25752024-11-14T06:32:29.936ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "85175866-bbb5-40ef-acce-961425c515d6", "content-length": "26", "date": "Thu, 14 Nov 2024 06:32:29 GMT"} })
25762024-11-14T06:32:29.936ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25772024-11-14T06:32:29.938ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
25782024-11-14T06:32:29.959ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 385.598317ms iteration = 27 status = {}
25792024-11-14T06:32:29.961ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
25802024-11-14T06:32:29.961ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 386.496134ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
25812024-11-14T06:32:30.071ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
25822024-11-14T06:32:30.072ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "5b163fd6-5f59-4370-9510-1bd42520cceb", "date": "Thu, 14 Nov 2024 06:32:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
25832024-11-14T06:32:30.072ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
25842024-11-14T06:32:30.073ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "4ad53aa4-a18a-4b85-893e-cc6728c255b6", "date": "Thu, 14 Nov 2024 06:32:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
25852024-11-14T06:32:30.073ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
25862024-11-14T06:32:30.075ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "46b8e8ce-dc84-4540-be4b-7823e86ee595", "date": "Thu, 14 Nov 2024 06:32:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
25872024-11-14T06:32:30.075ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
25882024-11-14T06:32:30.076ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
25892024-11-14T06:32:30.076ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 502.417662ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
25902024-11-14T06:32:30.125ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
25912024-11-14T06:32:30.126ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "1774c3be-e222-4f06-b153-0d37e0cffd15", "content-length": "2", "date": "Thu, 14 Nov 2024 06:32:29 GMT"} })
25922024-11-14T06:32:30.127ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
25932024-11-14T06:32:30.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
25942024-11-14T06:32:30.130ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 556.153172ms iteration = 27 status = null
25952024-11-14T06:32:30.164ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
25962024-11-14T06:32:30.165ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "255f6585-457d-4322-9c27-f9c0675b9f54", "date": "Thu, 14 Nov 2024 06:32:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
25972024-11-14T06:32:30.165ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
25982024-11-14T06:32:30.167ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "2d3b8529-87bd-4d53-b6bf-ce6a9b238417", "date": "Thu, 14 Nov 2024 06:32:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
25992024-11-14T06:32:30.167ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
26002024-11-14T06:32:30.169ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
26012024-11-14T06:32:30.169ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 595.22636ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
26022024-11-14T06:32:30.178ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
26032024-11-14T06:32:30.200ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26042024-11-14T06:32:30.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26052024-11-14T06:32:30.202ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: cecfafa4-4697-4aa6-949f-23c34aa9d5bd, rack_id: f391bffc-9f2b-4c87-85cd-2718afa7cb93, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(58c91208-be0a-4936-a7c2-2ae07694e16d) } rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
26062024-11-14T06:32:30.202ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26072024-11-14T06:32:30.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26082024-11-14T06:32:30.212ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
26092024-11-14T06:32:30.212ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ac9cddb-1873-4d61-a6dd-5ef3ecb9c78a", "content-length": "134", "date": "Thu, 14 Nov 2024 06:32:30 GMT"} })
26102024-11-14T06:32:30.212ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
26112024-11-14T06:32:30.212ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 58c91208-be0a-4936-a7c2-2ae07694e16d
26122024-11-14T06:32:30.213ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
26132024-11-14T06:32:30.213ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
26142024-11-14T06:32:30.213ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26152024-11-14T06:32:30.213ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26162024-11-14T06:32:30.213ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26172024-11-14T06:32:30.213ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
26182024-11-14T06:32:30.213ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26192024-11-14T06:32:30.213ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
26202024-11-14T06:32:30.213ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
26212024-11-14T06:32:30.213ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26222024-11-14T06:32:30.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26232024-11-14T06:32:30.215ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
26242024-11-14T06:32:30.215ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a25d1c2-2115-44f2-91d4-f4e849e723cd", "content-length": "2", "date": "Thu, 14 Nov 2024 06:32:30 GMT"} })
26252024-11-14T06:32:30.215ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
26262024-11-14T06:32:30.215ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ccfb6c0b-3750-43be-9b98-607fd57c4923", "content-length": "52", "date": "Thu, 14 Nov 2024 06:32:30 GMT"} })
26272024-11-14T06:32:30.215ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
26282024-11-14T06:32:30.215ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
26292024-11-14T06:32:30.269ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a34ff8a-8faa-4439-aeaa-d96061f7407c", "content-length": "691", "date": "Thu, 14 Nov 2024 06:32:30 GMT"} })
26302024-11-14T06:32:30.269ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
26312024-11-14T06:32:30.269ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
26322024-11-14T06:32:30.269ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
26332024-11-14T06:32:30.271ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 696.871202ms iteration = 28 status = {}
26342024-11-14T06:32:30.364ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "3270214a-1f4a-42df-848d-a3cbe5324b0a", "date": "Thu, 14 Nov 2024 06:32:30 GMT"} })
26352024-11-14T06:32:30.364ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch = Switch0
26362024-11-14T06:32:30.364ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
26372024-11-14T06:32:30.364ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc065553-e4e2-4ffd-91a8-910fe0ce7380", "content-length": "682", "date": "Thu, 14 Nov 2024 06:32:30 GMT"} })
26382024-11-14T06:32:30.364ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26392024-11-14T06:32:30.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26402024-11-14T06:32:30.368ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26412024-11-14T06:32:30.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26422024-11-14T06:32:30.371ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26432024-11-14T06:32:30.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26442024-11-14T06:32:30.373ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26452024-11-14T06:32:30.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26462024-11-14T06:32:30.380ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 806.465501ms iteration = 27 status = {}
26472024-11-14T06:32:30.894ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = eaa5b3d6-7588-454d-a87d-6a683855be62 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
26482024-11-14T06:32:30.894ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = eaa5b3d6-7588-454d-a87d-6a683855be62 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
26492024-11-14T06:32:30.896ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2163 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = eaa5b3d6-7588-454d-a87d-6a683855be62 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
26502024-11-14T06:32:31.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 005cfc6c-59d8-4c4e-b531-edd80983ae98 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
26512024-11-14T06:32:31.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 005cfc6c-59d8-4c4e-b531-edd80983ae98 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
26522024-11-14T06:32:31.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2489 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 005cfc6c-59d8-4c4e-b531-edd80983ae98 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
26532024-11-14T06:32:32.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36021 req_id = 1ff89809-874c-4818-bcc1-08c8f7c3d9b1 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/12?limit=100
26542024-11-14T06:32:32.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36021 req_id = 1ff89809-874c-4818-bcc1-08c8f7c3d9b1 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/12?limit=100
26552024-11-14T06:32:32.022ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3373 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36021 req_id = 1ff89809-874c-4818-bcc1-08c8f7c3d9b1 response_code = 200 uri = /nat/ipv4/changeset/12?limit=100
26562024-11-14T06:32:32.940ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = ab62c885-629b-456d-9846-5f1d3aaf261a roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
26572024-11-14T06:32:32.940ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = ab62c885-629b-456d-9846-5f1d3aaf261a resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
26582024-11-14T06:32:32.942ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2598 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = ab62c885-629b-456d-9846-5f1d3aaf261a response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
26592024-11-14T06:32:33.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = fd31798e-24dc-4ab6-a1a1-ea1b4309a778 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
26602024-11-14T06:32:33.961ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = fd31798e-24dc-4ab6-a1a1-ea1b4309a778 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
26612024-11-14T06:32:33.963ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2362 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = fd31798e-24dc-4ab6-a1a1-ea1b4309a778 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
26622024-11-14T06:32:34.983ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = b47a9dbd-efe0-4186-9a39-c9b406b16e37 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
26632024-11-14T06:32:34.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = b47a9dbd-efe0-4186-9a39-c9b406b16e37 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
26642024-11-14T06:32:34.985ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2049 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = b47a9dbd-efe0-4186-9a39-c9b406b16e37 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
26652024-11-14T06:32:36.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 5bced0ce-64f0-437e-8154-39a7c776b35d roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
26662024-11-14T06:32:36.006ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 5bced0ce-64f0-437e-8154-39a7c776b35d resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
26672024-11-14T06:32:36.008ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2267 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 5bced0ce-64f0-437e-8154-39a7c776b35d response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
26682024-11-14T06:32:37.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 018f3b59-b297-4b84-9c38-64ac2464e821 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
26692024-11-14T06:32:37.030ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 018f3b59-b297-4b84-9c38-64ac2464e821 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
26702024-11-14T06:32:37.032ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2652 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 018f3b59-b297-4b84-9c38-64ac2464e821 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
26712024-11-14T06:32:37.605ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 690 local_addr = [fd00:1122:3344:101::c]:60882 method = GET remote_addr = [fd00:1122:3344:101::d]:64488 req_id = 94054f2b-951e-42b2-90f6-871168b48406 response_code = 200 uri = /80190dc3-d884-49a0-b9a3-38d31e8c655a
26722024-11-14T06:32:38.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = d0d0820e-5526-4b2c-98ca-f9bcc561f4dd roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
26732024-11-14T06:32:38.052ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = d0d0820e-5526-4b2c-98ca-f9bcc561f4dd resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
26742024-11-14T06:32:38.054ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2164 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = d0d0820e-5526-4b2c-98ca-f9bcc561f4dd response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
26752024-11-14T06:32:39.076ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 0e3a6416-71ec-4161-9704-3bbec07af75b roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
26762024-11-14T06:32:39.077ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 0e3a6416-71ec-4161-9704-3bbec07af75b resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
26772024-11-14T06:32:39.079ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2603 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 0e3a6416-71ec-4161-9704-3bbec07af75b response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
26782024-11-14T06:32:39.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
26792024-11-14T06:32:39.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26802024-11-14T06:32:39.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
26812024-11-14T06:32:39.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26822024-11-14T06:32:39.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26832024-11-14T06:32:39.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26842024-11-14T06:32:39.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26852024-11-14T06:32:39.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
26862024-11-14T06:32:39.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26872024-11-14T06:32:39.609ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26882024-11-14T06:32:39.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26892024-11-14T06:32:39.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26902024-11-14T06:32:39.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26912024-11-14T06:32:39.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26922024-11-14T06:32:39.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26932024-11-14T06:32:39.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
26942024-11-14T06:32:39.615ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26952024-11-14T06:32:39.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26962024-11-14T06:32:39.625ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
26972024-11-14T06:32:39.625ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 51.058611ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
26982024-11-14T06:32:39.638ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.657113ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
26992024-11-14T06:32:40.100ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 1cca8b36-a071-4505-922d-7c8ce8903178 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27002024-11-14T06:32:40.101ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 1cca8b36-a071-4505-922d-7c8ce8903178 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27012024-11-14T06:32:40.102ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1918 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 1cca8b36-a071-4505-922d-7c8ce8903178 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27022024-11-14T06:32:41.123ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 73c3abde-cf05-4c18-b07f-a1a70b93a1ee roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27032024-11-14T06:32:41.123ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 73c3abde-cf05-4c18-b07f-a1a70b93a1ee resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27042024-11-14T06:32:41.125ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2173 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 73c3abde-cf05-4c18-b07f-a1a70b93a1ee response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27052024-11-14T06:32:42.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 69cd1ead-5f74-499a-ae7e-55f73926c72c roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27062024-11-14T06:32:42.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 69cd1ead-5f74-499a-ae7e-55f73926c72c resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27072024-11-14T06:32:42.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2874 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 69cd1ead-5f74-499a-ae7e-55f73926c72c response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27082024-11-14T06:32:43.170ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = aa8d53c4-585e-479e-90c2-e2ea26a99107 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27092024-11-14T06:32:43.170ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = aa8d53c4-585e-479e-90c2-e2ea26a99107 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27102024-11-14T06:32:43.172ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2411 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = aa8d53c4-585e-479e-90c2-e2ea26a99107 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27112024-11-14T06:32:44.193ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f771037e-ceee-490b-bff3-04f97341d507 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27122024-11-14T06:32:44.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f771037e-ceee-490b-bff3-04f97341d507 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27132024-11-14T06:32:44.195ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2104 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f771037e-ceee-490b-bff3-04f97341d507 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27142024-11-14T06:32:45.216ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = e0931b6d-fb70-4a24-8aca-1a57c3847430 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27152024-11-14T06:32:45.217ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = e0931b6d-fb70-4a24-8aca-1a57c3847430 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27162024-11-14T06:32:45.219ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2616 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = e0931b6d-fb70-4a24-8aca-1a57c3847430 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27172024-11-14T06:32:46.239ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = ec254c52-b341-48a3-819c-0da7157dcc05 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27182024-11-14T06:32:46.239ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = ec254c52-b341-48a3-819c-0da7157dcc05 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27192024-11-14T06:32:46.241ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2167 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = ec254c52-b341-48a3-819c-0da7157dcc05 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27202024-11-14T06:32:47.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = cd0f275d-12e4-498d-ab83-0b338ab562a4 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27212024-11-14T06:32:47.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = cd0f275d-12e4-498d-ab83-0b338ab562a4 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27222024-11-14T06:32:47.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2288 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = cd0f275d-12e4-498d-ab83-0b338ab562a4 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27232024-11-14T06:32:48.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = c1bf050a-11c1-4fea-b1df-4a67e2f6ebc7 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27242024-11-14T06:32:48.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = c1bf050a-11c1-4fea-b1df-4a67e2f6ebc7 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27252024-11-14T06:32:48.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2596 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = c1bf050a-11c1-4fea-b1df-4a67e2f6ebc7 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27262024-11-14T06:32:49.310ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 58c4f30a-d541-4700-8492-4d8e715e09c5 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27272024-11-14T06:32:49.311ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 58c4f30a-d541-4700-8492-4d8e715e09c5 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27282024-11-14T06:32:49.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2150 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 58c4f30a-d541-4700-8492-4d8e715e09c5 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27292024-11-14T06:32:49.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
27302024-11-14T06:32:49.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
27312024-11-14T06:32:49.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27322024-11-14T06:32:49.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27332024-11-14T06:32:49.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27342024-11-14T06:32:49.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27352024-11-14T06:32:49.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27362024-11-14T06:32:49.578ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27372024-11-14T06:32:49.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27382024-11-14T06:32:49.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27392024-11-14T06:32:49.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27402024-11-14T06:32:49.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27412024-11-14T06:32:49.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27422024-11-14T06:32:49.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
27432024-11-14T06:32:49.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27442024-11-14T06:32:49.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27452024-11-14T06:32:49.591ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
27462024-11-14T06:32:49.591ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.000597ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
27472024-11-14T06:32:49.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27482024-11-14T06:32:49.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27492024-11-14T06:32:49.637ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.36405ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27502024-11-14T06:32:50.334ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 4f5129d2-0bed-4404-9001-811c0e30a90c roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27512024-11-14T06:32:50.334ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 4f5129d2-0bed-4404-9001-811c0e30a90c resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27522024-11-14T06:32:50.336ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2280 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 4f5129d2-0bed-4404-9001-811c0e30a90c response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27532024-11-14T06:32:51.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 6ddc1a74-b98c-489b-befa-50ceae985f39 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27542024-11-14T06:32:51.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 6ddc1a74-b98c-489b-befa-50ceae985f39 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27552024-11-14T06:32:51.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2834 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 6ddc1a74-b98c-489b-befa-50ceae985f39 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27562024-11-14T06:32:52.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 446e6db1-54d2-4aab-8316-7eeac84455a0 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27572024-11-14T06:32:52.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 446e6db1-54d2-4aab-8316-7eeac84455a0 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27582024-11-14T06:32:52.383ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2070 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 446e6db1-54d2-4aab-8316-7eeac84455a0 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27592024-11-14T06:32:52.606ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 918 local_addr = [fd00:1122:3344:101::c]:60882 method = GET remote_addr = [fd00:1122:3344:101::d]:64488 req_id = c5e2be00-2434-4877-bc30-eb8ace114dea response_code = 200 uri = /80190dc3-d884-49a0-b9a3-38d31e8c655a
27602024-11-14T06:32:53.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 3662aa9c-a647-4597-823a-37fed29de143 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27612024-11-14T06:32:53.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 3662aa9c-a647-4597-823a-37fed29de143 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27622024-11-14T06:32:53.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2192 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 3662aa9c-a647-4597-823a-37fed29de143 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27632024-11-14T06:32:54.425ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 78fd4f3b-5666-4f49-b971-ccb13cba5102 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27642024-11-14T06:32:54.425ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 78fd4f3b-5666-4f49-b971-ccb13cba5102 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27652024-11-14T06:32:54.428ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2454 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 78fd4f3b-5666-4f49-b971-ccb13cba5102 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27662024-11-14T06:32:55.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 92d75825-8b8f-4ce8-97ed-f7251312b476 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27672024-11-14T06:32:55.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 92d75825-8b8f-4ce8-97ed-f7251312b476 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27682024-11-14T06:32:55.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2618 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 92d75825-8b8f-4ce8-97ed-f7251312b476 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27692024-11-14T06:32:56.472ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 099d8981-1a70-4544-9002-b5f0214271c0 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27702024-11-14T06:32:56.472ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 099d8981-1a70-4544-9002-b5f0214271c0 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27712024-11-14T06:32:56.474ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2324 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 099d8981-1a70-4544-9002-b5f0214271c0 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27722024-11-14T06:32:57.495ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = c802ac9f-113a-41b6-b53b-77e6a1d72b57 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27732024-11-14T06:32:57.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = c802ac9f-113a-41b6-b53b-77e6a1d72b57 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27742024-11-14T06:32:57.497ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2261 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = c802ac9f-113a-41b6-b53b-77e6a1d72b57 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27752024-11-14T06:32:57.598ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:53055
27762024-11-14T06:32:57.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53055 req_id = a7d088be-3014-4866-baa5-c57ea2860247 roles = RoleSet { roles: {} } uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
27772024-11-14T06:32:57.599ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53055 req_id = a7d088be-3014-4866-baa5-c57ea2860247 resource = Database result = Ok(()) uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
27782024-11-14T06:32:57.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3401 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53055 req_id = a7d088be-3014-4866-baa5-c57ea2860247 response_code = 200 uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
27792024-11-14T06:32:57.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53055 req_id = cc8853b8-78f4-4fbc-b268-1d50b83cfce4 roles = RoleSet { roles: {} } uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
27802024-11-14T06:32:57.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53055 req_id = cc8853b8-78f4-4fbc-b268-1d50b83cfce4 resource = Database result = Ok(()) uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
27812024-11-14T06:32:57.604ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2202 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53055 req_id = cc8853b8-78f4-4fbc-b268-1d50b83cfce4 response_code = 200 uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
27822024-11-14T06:32:58.518ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 842d50a6-b8ba-47ca-8ddb-5cba2efa327f roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27832024-11-14T06:32:58.519ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 842d50a6-b8ba-47ca-8ddb-5cba2efa327f resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27842024-11-14T06:32:58.521ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2315 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 842d50a6-b8ba-47ca-8ddb-5cba2efa327f response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27852024-11-14T06:32:59.543ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 580ffa1b-682e-48f7-a049-6d38ca4ef45d roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27862024-11-14T06:32:59.544ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 580ffa1b-682e-48f7-a049-6d38ca4ef45d resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27872024-11-14T06:32:59.545ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2220 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 580ffa1b-682e-48f7-a049-6d38ca4ef45d response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
27882024-11-14T06:32:59.574ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 28 reason = Timeout
27892024-11-14T06:32:59.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 28 reason = Timeout
27902024-11-14T06:32:59.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
27912024-11-14T06:32:59.574ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27922024-11-14T06:32:59.574ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 28 reason = Timeout
27932024-11-14T06:32:59.574ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
27942024-11-14T06:32:59.574ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
27952024-11-14T06:32:59.574ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
27962024-11-14T06:32:59.574ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 31 reason = Timeout
27972024-11-14T06:32:59.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 82 reason = Timeout
27982024-11-14T06:32:59.574ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27992024-11-14T06:32:59.574ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 28 reason = Timeout
28002024-11-14T06:32:59.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28012024-11-14T06:32:59.574ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 28 reason = Timeout
28022024-11-14T06:32:59.574ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
28032024-11-14T06:32:59.574ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28042024-11-14T06:32:59.574ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 28 reason = Timeout
28052024-11-14T06:32:59.574ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
28062024-11-14T06:32:59.574ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 29 reason = Timeout
28072024-11-14T06:32:59.574ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28082024-11-14T06:32:59.574ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 28 reason = Timeout
28092024-11-14T06:32:59.574ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
28102024-11-14T06:32:59.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 82 reason = Timeout
28112024-11-14T06:32:59.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28122024-11-14T06:32:59.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
28132024-11-14T06:32:59.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
28142024-11-14T06:32:59.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28152024-11-14T06:32:59.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28162024-11-14T06:32:59.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
28172024-11-14T06:32:59.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28182024-11-14T06:32:59.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28192024-11-14T06:32:59.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28202024-11-14T06:32:59.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
28212024-11-14T06:32:59.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
28222024-11-14T06:32:59.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28232024-11-14T06:32:59.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 28 reason = Timeout
28242024-11-14T06:32:59.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 28 reason = Timeout
28252024-11-14T06:32:59.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
28262024-11-14T06:32:59.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
28272024-11-14T06:32:59.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 28 reason = Timeout
28282024-11-14T06:32:59.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
28292024-11-14T06:32:59.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 28 reason = Timeout
28302024-11-14T06:32:59.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
28312024-11-14T06:32:59.575ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 29 reason = Timeout
28322024-11-14T06:32:59.575ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
28332024-11-14T06:32:59.575ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28342024-11-14T06:32:59.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
28352024-11-14T06:32:59.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
28362024-11-14T06:32:59.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
28372024-11-14T06:32:59.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28382024-11-14T06:32:59.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
28392024-11-14T06:32:59.577ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28402024-11-14T06:32:59.577ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28412024-11-14T06:32:59.578ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.79983ms iteration = 28 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
28422024-11-14T06:32:59.578ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28432024-11-14T06:32:59.578ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
28442024-11-14T06:32:59.578ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
28452024-11-14T06:32:59.578ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
28462024-11-14T06:32:59.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
28472024-11-14T06:32:59.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
28482024-11-14T06:32:59.580ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
28492024-11-14T06:32:59.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
28502024-11-14T06:32:59.580ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28512024-11-14T06:32:59.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
28522024-11-14T06:32:59.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28532024-11-14T06:32:59.581ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
28542024-11-14T06:32:59.581ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28552024-11-14T06:32:59.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28562024-11-14T06:32:59.582ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28572024-11-14T06:32:59.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28582024-11-14T06:32:59.583ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1836, tv_nsec: 141465714 } })
28592024-11-14T06:32:59.583ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1836, tv_nsec: 141536646 } })
28602024-11-14T06:32:59.583ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
28612024-11-14T06:32:59.583ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
28622024-11-14T06:32:59.588ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1836, tv_nsec: 146397236 } })
28632024-11-14T06:32:59.588ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
28642024-11-14T06:32:59.588ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28652024-11-14T06:32:59.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28662024-11-14T06:32:59.619ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
28672024-11-14T06:32:59.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
28682024-11-14T06:32:59.620ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28692024-11-14T06:32:59.622ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28702024-11-14T06:32:59.622ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
28712024-11-14T06:32:59.622ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28722024-11-14T06:32:59.622ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 47.555855ms iteration = 28 status = {"errors":[],"garbage_collect_requested":[]}
28732024-11-14T06:32:59.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28742024-11-14T06:32:59.624ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28752024-11-14T06:32:59.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28762024-11-14T06:32:59.624ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
28772024-11-14T06:32:59.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
28782024-11-14T06:32:59.626ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28792024-11-14T06:32:59.626ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28802024-11-14T06:32:59.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28812024-11-14T06:32:59.628ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
28822024-11-14T06:32:59.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
28832024-11-14T06:32:59.630ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
28842024-11-14T06:32:59.630ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
28852024-11-14T06:32:59.630ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
28862024-11-14T06:32:59.630ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28872024-11-14T06:32:59.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
28882024-11-14T06:32:59.631ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28892024-11-14T06:32:59.631ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 56.015483ms iteration = 28 status = {"errors":[],"records_set_to_done":[]}
28902024-11-14T06:32:59.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28912024-11-14T06:32:59.633ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28922024-11-14T06:32:59.633ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
28932024-11-14T06:32:59.633ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28942024-11-14T06:32:59.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28952024-11-14T06:32:59.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28962024-11-14T06:32:59.635ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 60.903274ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
28972024-11-14T06:32:59.635ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.913134ms iteration = 82 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28982024-11-14T06:32:59.636ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28992024-11-14T06:32:59.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29002024-11-14T06:32:59.637ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
29012024-11-14T06:32:59.637ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 62.787388ms iteration = 28 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
29022024-11-14T06:32:59.638ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29032024-11-14T06:32:59.640ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 27a56cb4-44ff-4d5b-931e-1c2c0642844d, lookup_type: ById(27a56cb4-44ff-4d5b-931e-1c2c0642844d) } result = Ok(())
29042024-11-14T06:32:59.640ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29052024-11-14T06:32:59.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29062024-11-14T06:32:59.645ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 71.083583ms iteration = 28 status = 0
29072024-11-14T06:32:59.666ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 91.553535ms iteration = 28 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
29082024-11-14T06:32:59.669ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
29092024-11-14T06:32:59.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29102024-11-14T06:32:59.670ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
29112024-11-14T06:32:59.670ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
29122024-11-14T06:32:59.670ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 96.673589ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
29132024-11-14T06:32:59.671ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 96.143289ms iteration = 28 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
29142024-11-14T06:32:59.671ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29152024-11-14T06:32:59.672ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29162024-11-14T06:32:59.674ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
29172024-11-14T06:32:59.674ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29182024-11-14T06:32:59.674ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
29192024-11-14T06:32:59.674ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
29202024-11-14T06:32:59.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29212024-11-14T06:32:59.674ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "da3c91f0-136b-4dee-af23-65b4d472dfd9", "content-length": "26", "date": "Thu, 14 Nov 2024 06:32:59 GMT"} })
29222024-11-14T06:32:59.674ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
29232024-11-14T06:32:59.675ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
29242024-11-14T06:32:59.675ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29252024-11-14T06:32:59.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29262024-11-14T06:32:59.676ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
29272024-11-14T06:32:59.680ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29282024-11-14T06:32:59.682ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
29292024-11-14T06:32:59.682ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29302024-11-14T06:32:59.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29312024-11-14T06:32:59.685ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
29322024-11-14T06:32:59.685ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
29332024-11-14T06:32:59.686ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "aafddc48-364f-406c-b110-9e14101ac08d", "content-length": "26", "date": "Thu, 14 Nov 2024 06:32:59 GMT"} })
29342024-11-14T06:32:59.686ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
29352024-11-14T06:32:59.687ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 zone_address = fd00:1122:3344:101::2
29362024-11-14T06:32:59.687ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
29372024-11-14T06:32:59.687ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b8ae5675-e0c7-4c80-a2c4-530402e02f9d", "content-length": "26", "date": "Thu, 14 Nov 2024 06:32:59 GMT"} })
29382024-11-14T06:32:59.687ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
29392024-11-14T06:32:59.688ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
29402024-11-14T06:32:59.689ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
29412024-11-14T06:32:59.698ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
29422024-11-14T06:32:59.698ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 124.012018ms iteration = 82 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
29432024-11-14T06:32:59.701ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29442024-11-14T06:32:59.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29452024-11-14T06:32:59.716ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 142.620105ms iteration = 31 status = {"physical_disks_added":0}
29462024-11-14T06:32:59.736ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29472024-11-14T06:32:59.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29482024-11-14T06:32:59.738ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29492024-11-14T06:32:59.739ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
29502024-11-14T06:32:59.740ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29512024-11-14T06:32:59.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29522024-11-14T06:32:59.741ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29532024-11-14T06:32:59.743ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
29542024-11-14T06:32:59.743ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29552024-11-14T06:32:59.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29562024-11-14T06:32:59.774ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
29572024-11-14T06:32:59.774ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "7388c03d-5e0c-4bfb-ad3d-1d6a314d460f", "content-length": "2", "date": "Thu, 14 Nov 2024 06:32:58 GMT"} })
29582024-11-14T06:32:59.775ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 201.022772ms iteration = 28 status = {}
29592024-11-14T06:32:59.775ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
29602024-11-14T06:32:59.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
29612024-11-14T06:32:59.814ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
29622024-11-14T06:32:59.814ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
29632024-11-14T06:32:59.816ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 242.31609ms iteration = 28 status = null
29642024-11-14T06:32:59.859ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "23f97854-2840-4230-9632-853d3f911b55", "content-length": "372", "date": "Thu, 14 Nov 2024 06:32:59 GMT"} })
29652024-11-14T06:32:59.859ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29662024-11-14T06:32:59.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29672024-11-14T06:32:59.864ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
29682024-11-14T06:32:59.866ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a054733-58fc-45ee-bb82-46febf238581", "content-length": "691", "date": "Thu, 14 Nov 2024 06:32:59 GMT"} })
29692024-11-14T06:32:59.866ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
29702024-11-14T06:32:59.866ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
29712024-11-14T06:32:59.866ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
29722024-11-14T06:32:59.868ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 293.764598ms iteration = 29 status = {}
29732024-11-14T06:32:59.873ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29742024-11-14T06:32:59.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29752024-11-14T06:32:59.875ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
29762024-11-14T06:32:59.875ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
29772024-11-14T06:32:59.875ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: cecfafa4-4697-4aa6-949f-23c34aa9d5bd, rack_id: f391bffc-9f2b-4c87-85cd-2718afa7cb93, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(58c91208-be0a-4936-a7c2-2ae07694e16d) } rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
29782024-11-14T06:32:59.875ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29792024-11-14T06:32:59.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29802024-11-14T06:32:59.881ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "566aed86-d0d5-46a5-9067-7792655006ff", "date": "Thu, 14 Nov 2024 06:32:59 GMT"} })
29812024-11-14T06:32:59.881ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29822024-11-14T06:32:59.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29832024-11-14T06:32:59.882ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
29842024-11-14T06:32:59.882ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e25eb95-4572-4cc4-bd25-3ed94f344335", "content-length": "134", "date": "Thu, 14 Nov 2024 06:32:59 GMT"} })
29852024-11-14T06:32:59.882ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
29862024-11-14T06:32:59.882ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 58c91208-be0a-4936-a7c2-2ae07694e16d
29872024-11-14T06:32:59.883ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
29882024-11-14T06:32:59.883ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
29892024-11-14T06:32:59.883ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29902024-11-14T06:32:59.883ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29912024-11-14T06:32:59.883ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29922024-11-14T06:32:59.883ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
29932024-11-14T06:32:59.883ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29942024-11-14T06:32:59.883ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
29952024-11-14T06:32:59.883ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29962024-11-14T06:32:59.883ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
29972024-11-14T06:32:59.883ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29982024-11-14T06:32:59.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29992024-11-14T06:32:59.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30002024-11-14T06:32:59.885ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
30012024-11-14T06:32:59.885ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "3399b229-5732-4190-9a0f-420d6d97a4e8", "content-length": "2", "date": "Thu, 14 Nov 2024 06:32:59 GMT"} })
30022024-11-14T06:32:59.885ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
30032024-11-14T06:32:59.885ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "935c981c-c7ee-435b-828a-5f18124cf99b", "content-length": "52", "date": "Thu, 14 Nov 2024 06:32:59 GMT"} })
30042024-11-14T06:32:59.885ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
30052024-11-14T06:32:59.885ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
30062024-11-14T06:32:59.886ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30072024-11-14T06:32:59.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30082024-11-14T06:32:59.890ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
30092024-11-14T06:32:59.890ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
30102024-11-14T06:32:59.895ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "900c6091-da13-4d62-935f-6f2e32e00ea0", "date": "Thu, 14 Nov 2024 06:32:59 GMT"} })
30112024-11-14T06:32:59.896ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 321.383702ms iteration = 29 status = {}
30122024-11-14T06:33:00.059ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "74f1c18b-09a4-488c-ace2-d1f78c3916c7", "date": "Thu, 14 Nov 2024 06:32:59 GMT"} })
30132024-11-14T06:33:00.059ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch = Switch0
30142024-11-14T06:33:00.059ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
30152024-11-14T06:33:00.059ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "17a90f72-d103-48a0-a438-267cf2ab2599", "content-length": "682", "date": "Thu, 14 Nov 2024 06:32:59 GMT"} })
30162024-11-14T06:33:00.059ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30172024-11-14T06:33:00.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30182024-11-14T06:33:00.063ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30192024-11-14T06:33:00.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30202024-11-14T06:33:00.066ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30212024-11-14T06:33:00.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30222024-11-14T06:33:00.068ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30232024-11-14T06:33:00.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30242024-11-14T06:33:00.075ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 501.599086ms iteration = 28 status = {}
30252024-11-14T06:33:00.447ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
30262024-11-14T06:33:00.447ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
30272024-11-14T06:33:00.477ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
30282024-11-14T06:33:00.477ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:62804
30292024-11-14T06:33:00.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:62804 req_id = f82eb5bf-0e9c-48e5-9011-1727145ebe18 roles = RoleSet { roles: {} } uri = /metrics/producers
30302024-11-14T06:33:00.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:62804 req_id = f82eb5bf-0e9c-48e5-9011-1727145ebe18 resource = Database result = Ok(()) uri = /metrics/producers
30312024-11-14T06:33:00.517ZINFOnexus: assigned collector to new producer collector_id = d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6 file = nexus/src/app/oximeter.rs:76 producer_id = 80190dc3-d884-49a0-b9a3-38d31e8c655a
30322024-11-14T06:33:00.517ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40089 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:62804 req_id = f82eb5bf-0e9c-48e5-9011-1727145ebe18 response_code = 201 uri = /metrics/producers
30332024-11-14T06:33:00.517ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "f82eb5bf-0e9c-48e5-9011-1727145ebe18", "content-length": "41", "date": "Thu, 14 Nov 2024 06:33:00 GMT"} })
30342024-11-14T06:33:00.519ZDEBGnexus (producer-registration-task): registered with nexus successfully
30352024-11-14T06:33:00.519ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
30362024-11-14T06:33:00.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 13ed7a71-804b-4d9b-960f-0d35652b6961 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
30372024-11-14T06:33:00.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 13ed7a71-804b-4d9b-960f-0d35652b6961 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
30382024-11-14T06:33:00.567ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2112 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 13ed7a71-804b-4d9b-960f-0d35652b6961 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
30392024-11-14T06:33:01.588ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 209648de-ace7-4661-b9fa-528e5cb7cbd2 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
30402024-11-14T06:33:01.588ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 209648de-ace7-4661-b9fa-528e5cb7cbd2 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
30412024-11-14T06:33:01.590ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2303 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 209648de-ace7-4661-b9fa-528e5cb7cbd2 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
30422024-11-14T06:33:02.054ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36021 req_id = 1ee687ad-d58c-4512-9896-586163d66c33 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/12?limit=100
30432024-11-14T06:33:02.055ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36021 req_id = 1ee687ad-d58c-4512-9896-586163d66c33 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/12?limit=100
30442024-11-14T06:33:02.058ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3631 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36021 req_id = 1ee687ad-d58c-4512-9896-586163d66c33 response_code = 200 uri = /nat/ipv4/changeset/12?limit=100
30452024-11-14T06:33:02.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 5ed55a8c-6894-4931-a18b-874b7fd06260 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
30462024-11-14T06:33:02.612ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 5ed55a8c-6894-4931-a18b-874b7fd06260 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
30472024-11-14T06:33:02.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2786 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 5ed55a8c-6894-4931-a18b-874b7fd06260 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
30482024-11-14T06:33:03.634ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 7e3be10d-dc5c-47a9-80e2-180bd1f15e14 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
30492024-11-14T06:33:03.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 7e3be10d-dc5c-47a9-80e2-180bd1f15e14 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
30502024-11-14T06:33:03.636ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1880 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 7e3be10d-dc5c-47a9-80e2-180bd1f15e14 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
30512024-11-14T06:33:04.656ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 03f56253-3d17-4a21-b79a-e0a411d9bd08 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
30522024-11-14T06:33:04.657ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 03f56253-3d17-4a21-b79a-e0a411d9bd08 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
30532024-11-14T06:33:04.659ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2908 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 03f56253-3d17-4a21-b79a-e0a411d9bd08 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
30542024-11-14T06:33:05.681ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = ebf76a7c-3a29-4970-b4d4-80081bcbf675 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
30552024-11-14T06:33:05.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = ebf76a7c-3a29-4970-b4d4-80081bcbf675 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
30562024-11-14T06:33:05.683ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2422 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = ebf76a7c-3a29-4970-b4d4-80081bcbf675 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
30572024-11-14T06:33:06.704ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 83052011-393d-4739-a6b8-6a7994eb5ddd roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
30582024-11-14T06:33:06.704ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 83052011-393d-4739-a6b8-6a7994eb5ddd resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
30592024-11-14T06:33:06.706ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2190 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 83052011-393d-4739-a6b8-6a7994eb5ddd response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
30602024-11-14T06:33:07.605ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 862 local_addr = [fd00:1122:3344:101::c]:60882 method = GET remote_addr = [fd00:1122:3344:101::d]:64488 req_id = 8ebf59e5-2a3d-4dd6-9aa4-ffb8a1f850c9 response_code = 200 uri = /80190dc3-d884-49a0-b9a3-38d31e8c655a
30612024-11-14T06:33:07.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 689e08fd-46ea-46a3-82ff-f08c887c2e5e roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
30622024-11-14T06:33:07.727ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 689e08fd-46ea-46a3-82ff-f08c887c2e5e resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
30632024-11-14T06:33:07.729ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2574 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 689e08fd-46ea-46a3-82ff-f08c887c2e5e response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
30642024-11-14T06:33:08.749ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 90824a79-4795-4d27-8397-ee11c3a3b312 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
30652024-11-14T06:33:08.750ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 90824a79-4795-4d27-8397-ee11c3a3b312 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
30662024-11-14T06:33:08.752ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2708 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 90824a79-4795-4d27-8397-ee11c3a3b312 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
30672024-11-14T06:33:09.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 83 reason = Timeout
30682024-11-14T06:33:09.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 83 reason = Timeout
30692024-11-14T06:33:09.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30702024-11-14T06:33:09.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30712024-11-14T06:33:09.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30722024-11-14T06:33:09.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30732024-11-14T06:33:09.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30742024-11-14T06:33:09.577ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30752024-11-14T06:33:09.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30762024-11-14T06:33:09.578ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
30772024-11-14T06:33:09.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30782024-11-14T06:33:09.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30792024-11-14T06:33:09.578ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.434053ms iteration = 83 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30802024-11-14T06:33:09.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30812024-11-14T06:33:09.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30822024-11-14T06:33:09.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30832024-11-14T06:33:09.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
30842024-11-14T06:33:09.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30852024-11-14T06:33:09.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30862024-11-14T06:33:09.596ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
30872024-11-14T06:33:09.596ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.821577ms iteration = 83 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
30882024-11-14T06:33:09.773ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = babbfe67-e772-4557-8c29-eb466599a97c roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
30892024-11-14T06:33:09.773ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = babbfe67-e772-4557-8c29-eb466599a97c resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
30902024-11-14T06:33:09.775ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2007 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = babbfe67-e772-4557-8c29-eb466599a97c response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
30912024-11-14T06:33:10.798ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 2153a0aa-1d67-4685-9e49-2ffad865754e roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
30922024-11-14T06:33:10.798ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 2153a0aa-1d67-4685-9e49-2ffad865754e resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
30932024-11-14T06:33:10.799ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1873 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 2153a0aa-1d67-4685-9e49-2ffad865754e response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
30942024-11-14T06:33:11.822ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 550b0517-90ab-4d56-b2d7-687d83eb591a roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
30952024-11-14T06:33:11.822ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 550b0517-90ab-4d56-b2d7-687d83eb591a resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
30962024-11-14T06:33:11.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2346 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 550b0517-90ab-4d56-b2d7-687d83eb591a response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
30972024-11-14T06:33:12.844ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 150dabab-33ed-481f-8c82-8ccaa0678cb4 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
30982024-11-14T06:33:12.845ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 150dabab-33ed-481f-8c82-8ccaa0678cb4 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
30992024-11-14T06:33:12.851ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6748 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 150dabab-33ed-481f-8c82-8ccaa0678cb4 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
31002024-11-14T06:33:13.873ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 3229baa9-e1fa-4470-9366-62723269da4a roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
31012024-11-14T06:33:13.874ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 3229baa9-e1fa-4470-9366-62723269da4a resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
31022024-11-14T06:33:13.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2883 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 3229baa9-e1fa-4470-9366-62723269da4a response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
31032024-11-14T06:33:14.899ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = fab16687-1e7e-4b26-b18e-d658b8d848be roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
31042024-11-14T06:33:14.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = fab16687-1e7e-4b26-b18e-d658b8d848be resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
31052024-11-14T06:33:14.901ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2530 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = fab16687-1e7e-4b26-b18e-d658b8d848be response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
31062024-11-14T06:33:15.923ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 84905b00-2e19-4ce7-9997-2cb374eeb064 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
31072024-11-14T06:33:15.924ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 84905b00-2e19-4ce7-9997-2cb374eeb064 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
31082024-11-14T06:33:15.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2182 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 84905b00-2e19-4ce7-9997-2cb374eeb064 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
31092024-11-14T06:33:16.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = df4ce85b-ff44-4bfc-abac-49cba31e30fb roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
31102024-11-14T06:33:16.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = df4ce85b-ff44-4bfc-abac-49cba31e30fb resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
31112024-11-14T06:33:16.950ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2616 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = df4ce85b-ff44-4bfc-abac-49cba31e30fb response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
31122024-11-14T06:33:17.972ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 11013073-9b11-4d13-b923-f59d1feb77db roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
31132024-11-14T06:33:17.972ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 11013073-9b11-4d13-b923-f59d1feb77db resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
31142024-11-14T06:33:17.974ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2652 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 11013073-9b11-4d13-b923-f59d1feb77db response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
31152024-11-14T06:33:18.995ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = be8b732a-a84b-4850-8b8e-0192bd73df78 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
31162024-11-14T06:33:18.996ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = be8b732a-a84b-4850-8b8e-0192bd73df78 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
31172024-11-14T06:33:18.998ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2436 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = be8b732a-a84b-4850-8b8e-0192bd73df78 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
31182024-11-14T06:33:19.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 84 reason = Timeout
31192024-11-14T06:33:19.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 84 reason = Timeout
31202024-11-14T06:33:19.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31212024-11-14T06:33:19.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31222024-11-14T06:33:19.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31232024-11-14T06:33:19.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31242024-11-14T06:33:19.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31252024-11-14T06:33:19.576ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31262024-11-14T06:33:19.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31272024-11-14T06:33:19.578ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.978554ms iteration = 84 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
31282024-11-14T06:33:19.578ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
31292024-11-14T06:33:19.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31302024-11-14T06:33:19.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31312024-11-14T06:33:19.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31322024-11-14T06:33:19.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31332024-11-14T06:33:19.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31342024-11-14T06:33:19.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
31352024-11-14T06:33:19.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31362024-11-14T06:33:19.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31372024-11-14T06:33:19.592ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
31382024-11-14T06:33:19.592ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.81184ms iteration = 84 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
31392024-11-14T06:33:20.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f0186e74-9175-483b-9b1e-12cd6e3a5748 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
31402024-11-14T06:33:20.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f0186e74-9175-483b-9b1e-12cd6e3a5748 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
31412024-11-14T06:33:20.022ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1980 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f0186e74-9175-483b-9b1e-12cd6e3a5748 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
31422024-11-14T06:33:21.043ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 93b901ae-b48a-421f-8126-4662f1b02221 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
31432024-11-14T06:33:21.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 93b901ae-b48a-421f-8126-4662f1b02221 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
31442024-11-14T06:33:21.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2659 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 93b901ae-b48a-421f-8126-4662f1b02221 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
31452024-11-14T06:33:22.069ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 206c6723-5e74-462c-b371-85116b5255a0 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
31462024-11-14T06:33:22.070ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 206c6723-5e74-462c-b371-85116b5255a0 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
31472024-11-14T06:33:22.072ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2306 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 206c6723-5e74-462c-b371-85116b5255a0 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
31482024-11-14T06:33:22.604ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 700 local_addr = [fd00:1122:3344:101::c]:60882 method = GET remote_addr = [fd00:1122:3344:101::d]:64488 req_id = 6097814b-883f-474f-9e2e-977782c0ce8d response_code = 200 uri = /80190dc3-d884-49a0-b9a3-38d31e8c655a
31492024-11-14T06:33:23.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 379dfb9a-2d17-4d4f-8984-6dc24d000a1c roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
31502024-11-14T06:33:23.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 379dfb9a-2d17-4d4f-8984-6dc24d000a1c resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
31512024-11-14T06:33:23.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2522 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 379dfb9a-2d17-4d4f-8984-6dc24d000a1c response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
31522024-11-14T06:33:24.118ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = b0cbcf15-a3e0-4dc4-a149-e97cb7cf999d roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
31532024-11-14T06:33:24.119ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = b0cbcf15-a3e0-4dc4-a149-e97cb7cf999d resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
31542024-11-14T06:33:24.121ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2611 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = b0cbcf15-a3e0-4dc4-a149-e97cb7cf999d response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
31552024-11-14T06:33:25.142ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = d1177354-0944-4ef0-ab13-e53175b5f764 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
31562024-11-14T06:33:25.142ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = d1177354-0944-4ef0-ab13-e53175b5f764 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
31572024-11-14T06:33:25.144ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2203 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = d1177354-0944-4ef0-ab13-e53175b5f764 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
31582024-11-14T06:33:26.166ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = e5ddf5ad-9adf-4aaa-bd2f-28c2fcde1178 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
31592024-11-14T06:33:26.167ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = e5ddf5ad-9adf-4aaa-bd2f-28c2fcde1178 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
31602024-11-14T06:33:26.169ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2402 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = e5ddf5ad-9adf-4aaa-bd2f-28c2fcde1178 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
31612024-11-14T06:33:27.191ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 47f79fb5-9a5f-4a76-8cb2-1e66dc5caca7 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
31622024-11-14T06:33:27.192ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 47f79fb5-9a5f-4a76-8cb2-1e66dc5caca7 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
31632024-11-14T06:33:27.194ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2279 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 47f79fb5-9a5f-4a76-8cb2-1e66dc5caca7 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
31642024-11-14T06:33:28.217ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 8f6b0280-1419-4b22-a023-0a3a7d48fffb roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
31652024-11-14T06:33:28.217ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 8f6b0280-1419-4b22-a023-0a3a7d48fffb resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
31662024-11-14T06:33:28.219ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2571 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 8f6b0280-1419-4b22-a023-0a3a7d48fffb response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
31672024-11-14T06:33:29.242ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 6f6a1727-4f27-4cea-b7a3-b2963730cf36 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
31682024-11-14T06:33:29.242ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 6f6a1727-4f27-4cea-b7a3-b2963730cf36 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
31692024-11-14T06:33:29.244ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2799 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 6f6a1727-4f27-4cea-b7a3-b2963730cf36 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
31702024-11-14T06:33:29.574ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 29 reason = Timeout
31712024-11-14T06:33:29.574ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 32 reason = Timeout
31722024-11-14T06:33:29.574ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31732024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31742024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 29 reason = Timeout
31752024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 29 reason = Timeout
31762024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 15 reason = Timeout
31772024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31782024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
31792024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
31802024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31812024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 17 reason = Timeout
31822024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 15 reason = Timeout
31832024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 29 reason = Timeout
31842024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
31852024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 85 reason = Timeout
31862024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 85 reason = Timeout
31872024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31882024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 15 reason = Timeout
31892024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31902024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
31912024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 29 reason = Timeout
31922024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 15 reason = Timeout
31932024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
31942024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 30 reason = Timeout
31952024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31962024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 15 reason = Timeout
31972024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31982024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 29 reason = Timeout
31992024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 17 reason = Timeout
32002024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
32012024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 15 reason = Timeout
32022024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 29 reason = Timeout
32032024-11-14T06:33:29.575ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 06:23:29.575191057 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
32042024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
32052024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
32062024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
32072024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 29 reason = Timeout
32082024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
32092024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 15 reason = Timeout
32102024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
32112024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32122024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 29 reason = Timeout
32132024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 15 reason = Timeout
32142024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 15 reason = Timeout
32152024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
32162024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
32172024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 29 reason = Timeout
32182024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
32192024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 29 reason = Timeout
32202024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
32212024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 29 reason = Timeout
32222024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
32232024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 30 reason = Timeout
32242024-11-14T06:33:29.575ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
32252024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32262024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 16 reason = Timeout
32272024-11-14T06:33:29.575ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 1d98d624-72d4-4466-8fe7-990461a3f886
32282024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.88\u{b5}s iteration = 16 status = {"enabled":false,"target_id":"1d98d624-72d4-4466-8fe7-990461a3f886"}
32292024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 15 reason = Timeout
32302024-11-14T06:33:29.575ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
32312024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
32322024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32332024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32342024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
32352024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32362024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32372024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
32382024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32392024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
32402024-11-14T06:33:29.575ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("720ac48b-8596-4763-a661-482d124c0a16.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f40de7f6-4bc1-4578-baeb-b08e777b4bed.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f40de7f6-4bc1-4578-baeb-b08e777b4bed.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1866, tv_nsec: 133684060 } })
32412024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
32422024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
32432024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32442024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
32452024-11-14T06:33:29.575ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("36c202a9-b541-4083-88f5-ff6483340b34.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("78c1624f-34e7-40fb-a468-bb6354445b73.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d40cb6d7-78a4-49d0-ae26-45907e21e06a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d40cb6d7-78a4-49d0-ae26-45907e21e06a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1866, tv_nsec: 133781372 } })
32462024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
32472024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32482024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32492024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
32502024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
32512024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
32522024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32532024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
32542024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
32552024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
32562024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32572024-11-14T06:33:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
32582024-11-14T06:33:29.576ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
32592024-11-14T06:33:29.576ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.117391ms iteration = 15 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
32602024-11-14T06:33:29.576ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
32612024-11-14T06:33:29.576ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.349296ms iteration = 15 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
32622024-11-14T06:33:29.577ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32632024-11-14T06:33:29.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32642024-11-14T06:33:29.578ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32652024-11-14T06:33:29.579ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1866, tv_nsec: 137110583 } })
32662024-11-14T06:33:29.579ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
32672024-11-14T06:33:29.579ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32682024-11-14T06:33:29.579ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32692024-11-14T06:33:29.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
32702024-11-14T06:33:29.580ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32712024-11-14T06:33:29.580ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.001733ms iteration = 29 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
32722024-11-14T06:33:29.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32732024-11-14T06:33:29.582ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32742024-11-14T06:33:29.582ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
32752024-11-14T06:33:29.582ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32762024-11-14T06:33:29.582ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32772024-11-14T06:33:29.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32782024-11-14T06:33:29.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32792024-11-14T06:33:29.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
32802024-11-14T06:33:29.583ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32812024-11-14T06:33:29.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32822024-11-14T06:33:29.584ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1866, tv_nsec: 142880341 } })
32832024-11-14T06:33:29.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
32842024-11-14T06:33:29.585ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
32852024-11-14T06:33:29.585ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
32862024-11-14T06:33:29.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
32872024-11-14T06:33:29.585ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 10.371193ms iteration = 15 status = {"errors":[],"found_port_ok":[]}
32882024-11-14T06:33:29.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32892024-11-14T06:33:29.588ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32902024-11-14T06:33:29.589ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
32912024-11-14T06:33:29.589ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
32922024-11-14T06:33:29.589ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 14.072392ms iteration = 15 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
32932024-11-14T06:33:29.589ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 06:23:29.575191057 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
32942024-11-14T06:33:29.589ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 14.594372ms iteration = 15 status = {"expiration":"2024-11-14T06:23:29.575191057Z","pruned":[]}
32952024-11-14T06:33:29.591ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
32962024-11-14T06:33:29.591ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32972024-11-14T06:33:29.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32982024-11-14T06:33:29.592ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
32992024-11-14T06:33:29.592ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33002024-11-14T06:33:29.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33012024-11-14T06:33:29.593ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33022024-11-14T06:33:29.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33032024-11-14T06:33:29.595ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
33042024-11-14T06:33:29.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
33052024-11-14T06:33:29.595ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 20.243917ms iteration = 29 status = {"errors":[],"garbage_collect_requested":[]}
33062024-11-14T06:33:29.600ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33072024-11-14T06:33:29.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33082024-11-14T06:33:29.605ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33092024-11-14T06:33:29.605ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33102024-11-14T06:33:29.607ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1866, tv_nsec: 165232157 } })
33112024-11-14T06:33:29.607ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
33122024-11-14T06:33:29.607ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33132024-11-14T06:33:29.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33142024-11-14T06:33:29.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
33152024-11-14T06:33:29.609ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
33162024-11-14T06:33:29.609ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33172024-11-14T06:33:29.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
33182024-11-14T06:33:29.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33192024-11-14T06:33:29.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
33202024-11-14T06:33:29.616ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33212024-11-14T06:33:29.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33222024-11-14T06:33:29.618ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33232024-11-14T06:33:29.619ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33242024-11-14T06:33:29.620ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33252024-11-14T06:33:29.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33262024-11-14T06:33:29.623ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
33272024-11-14T06:33:29.623ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33282024-11-14T06:33:29.623ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
33292024-11-14T06:33:29.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33302024-11-14T06:33:29.627ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33312024-11-14T06:33:29.632ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33322024-11-14T06:33:29.635ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
33332024-11-14T06:33:29.635ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33342024-11-14T06:33:29.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33352024-11-14T06:33:29.637ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
33362024-11-14T06:33:29.637ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33372024-11-14T06:33:29.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33382024-11-14T06:33:29.654ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 79.600341ms iteration = 29 status = {"errors":[],"records_set_to_done":[]}
33392024-11-14T06:33:29.659ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
33402024-11-14T06:33:29.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
33412024-11-14T06:33:29.663ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 88.59593ms iteration = 29 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
33422024-11-14T06:33:29.665ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
33432024-11-14T06:33:29.665ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 90.476694ms iteration = 85 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
33442024-11-14T06:33:29.668ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 93.280576ms iteration = 85 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
33452024-11-14T06:33:29.672ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
33462024-11-14T06:33:29.672ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
33472024-11-14T06:33:29.672ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
33482024-11-14T06:33:29.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
33492024-11-14T06:33:29.676ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
33502024-11-14T06:33:29.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
33512024-11-14T06:33:29.677ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
33522024-11-14T06:33:29.677ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
33532024-11-14T06:33:29.677ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
33542024-11-14T06:33:29.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
33552024-11-14T06:33:29.678ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
33562024-11-14T06:33:29.678ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
33572024-11-14T06:33:29.678ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
33582024-11-14T06:33:29.678ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
33592024-11-14T06:33:29.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
33602024-11-14T06:33:29.678ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33612024-11-14T06:33:29.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33622024-11-14T06:33:29.680ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
33632024-11-14T06:33:29.680ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
33642024-11-14T06:33:29.680ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 105.564135ms iteration = 29 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
33652024-11-14T06:33:29.681ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 106.678495ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
33662024-11-14T06:33:29.682ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33672024-11-14T06:33:29.684ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33682024-11-14T06:33:29.687ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
33692024-11-14T06:33:29.687ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33702024-11-14T06:33:29.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33712024-11-14T06:33:29.688ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
33722024-11-14T06:33:29.688ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33732024-11-14T06:33:29.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33742024-11-14T06:33:29.694ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33752024-11-14T06:33:29.695ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
33762024-11-14T06:33:29.695ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
33772024-11-14T06:33:29.695ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 119.764489ms iteration = 15 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
33782024-11-14T06:33:29.697ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
33792024-11-14T06:33:29.697ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33802024-11-14T06:33:29.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33812024-11-14T06:33:29.703ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33822024-11-14T06:33:29.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33832024-11-14T06:33:29.710ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
33842024-11-14T06:33:29.710ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
33852024-11-14T06:33:29.710ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
33862024-11-14T06:33:29.710ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33872024-11-14T06:33:29.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33882024-11-14T06:33:29.710ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33892024-11-14T06:33:29.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33902024-11-14T06:33:29.712ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33912024-11-14T06:33:29.713ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33922024-11-14T06:33:29.717ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
33932024-11-14T06:33:29.717ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33942024-11-14T06:33:29.717ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 142.472152ms iteration = 32 status = {"physical_disks_added":0}
33952024-11-14T06:33:29.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33962024-11-14T06:33:29.718ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 27a56cb4-44ff-4d5b-931e-1c2c0642844d, lookup_type: ById(27a56cb4-44ff-4d5b-931e-1c2c0642844d) } result = Ok(())
33972024-11-14T06:33:29.718ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33982024-11-14T06:33:29.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33992024-11-14T06:33:29.721ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 146.69083ms iteration = 29 status = 0
34002024-11-14T06:33:29.727ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
34012024-11-14T06:33:29.727ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 152.481698ms iteration = 29 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
34022024-11-14T06:33:29.738ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
34032024-11-14T06:33:29.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
34042024-11-14T06:33:29.740ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34052024-11-14T06:33:29.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34062024-11-14T06:33:29.748ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 173.53283ms iteration = 29 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
34072024-11-14T06:33:29.750ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34082024-11-14T06:33:29.753ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
34092024-11-14T06:33:29.753ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34102024-11-14T06:33:29.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34112024-11-14T06:33:29.757ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
34122024-11-14T06:33:29.757ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 30e11b92-f705-4c8e-bce7-d646f8ce00cf dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
34132024-11-14T06:33:29.757ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34142024-11-14T06:33:29.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34152024-11-14T06:33:29.759ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34162024-11-14T06:33:29.762ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
34172024-11-14T06:33:29.762ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34182024-11-14T06:33:29.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34192024-11-14T06:33:29.765ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T06:19:27.309503Z, time_modified: 2024-11-14T06:19:27.309503Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, db_silo: Silo { identity: SiloIdentity { id: 95153e51-68aa-4bd4-8e65-b8164172811d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T06:19:31.569300Z, time_modified: 2024-11-14T06:19:31.569300Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, db_silo: Silo { identity: SiloIdentity { id: 95153e51-68aa-4bd4-8e65-b8164172811d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T06:19:31.569300Z, time_modified: 2024-11-14T06:19:31.569300Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89" }] }) }
34202024-11-14T06:33:29.765ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 189.950166ms iteration = 15 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"95153e51-68aa-4bd4-8e65-b8164172811d","tls_certs":["3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89"]}},"default_endpoint":{"silo_id":"95153e51-68aa-4bd4-8e65-b8164172811d","tls_certs":["3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
34212024-11-14T06:33:29.766ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 30e11b92-f705-4c8e-bce7-d646f8ce00cf dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
34222024-11-14T06:33:29.766ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
34232024-11-14T06:33:29.766ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-14 06:19:30.340423 UTC dns_group = internal generation = 1
34242024-11-14T06:33:29.766ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 191.734389ms iteration = 15 status = {"generation":1}
34252024-11-14T06:33:29.769ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
34262024-11-14T06:33:29.769ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
34272024-11-14T06:33:29.769ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
34282024-11-14T06:33:29.769ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = c6d59938-b455-4e7b-9d17-0d6427a65b9c dns_zone_name = oxide.test found_so_far = 0 version = 2
34292024-11-14T06:33:29.769ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34302024-11-14T06:33:29.769ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "16230458-15bc-46cd-9739-383ee19e38a5", "content-length": "26", "date": "Thu, 14 Nov 2024 06:33:29 GMT"} })
34312024-11-14T06:33:29.769ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
34322024-11-14T06:33:29.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34332024-11-14T06:33:29.771ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34342024-11-14T06:33:29.771ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
34352024-11-14T06:33:29.772ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 zone_address = fd00:1122:3344:101::2
34362024-11-14T06:33:29.772ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
34372024-11-14T06:33:29.773ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "df50edc5-f3f7-4d62-a079-00c26d64d1b3", "content-length": "26", "date": "Thu, 14 Nov 2024 06:33:29 GMT"} })
34382024-11-14T06:33:29.773ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
34392024-11-14T06:33:29.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
34402024-11-14T06:33:29.774ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34412024-11-14T06:33:29.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34422024-11-14T06:33:29.775ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
34432024-11-14T06:33:29.776ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = c6d59938-b455-4e7b-9d17-0d6427a65b9c dns_zone_name = oxide.test found_so_far = 1 version = 2
34442024-11-14T06:33:29.776ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
34452024-11-14T06:33:29.776ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-14 06:19:31.616543 UTC dns_group = external generation = 2
34462024-11-14T06:33:29.776ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 201.574282ms iteration = 15 status = {"generation":2}
34472024-11-14T06:33:29.800ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34482024-11-14T06:33:29.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34492024-11-14T06:33:29.803ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
34502024-11-14T06:33:29.803ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
34512024-11-14T06:33:29.803ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
34522024-11-14T06:33:29.803ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ac8608f-b2c6-4a96-b41b-46b15319492c", "content-length": "26", "date": "Thu, 14 Nov 2024 06:33:29 GMT"} })
34532024-11-14T06:33:29.803ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
34542024-11-14T06:33:29.805ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
34552024-11-14T06:33:29.825ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
34562024-11-14T06:33:29.825ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 250.014873ms iteration = 15 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
34572024-11-14T06:33:29.947ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
34582024-11-14T06:33:29.947ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "f9e55005-271b-40ea-b2ec-adafe8945a2b", "content-length": "2", "date": "Thu, 14 Nov 2024 06:33:29 GMT"} })
34592024-11-14T06:33:29.949ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
34602024-11-14T06:33:29.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
34612024-11-14T06:33:29.957ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
34622024-11-14T06:33:30.141ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
34632024-11-14T06:33:30.141ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
34642024-11-14T06:33:30.142ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b865cd6b-698e-489d-8976-bd570cd2ff16", "content-length": "372", "date": "Thu, 14 Nov 2024 06:33:30 GMT"} })
34652024-11-14T06:33:30.142ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34662024-11-14T06:33:30.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34672024-11-14T06:33:30.143ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34682024-11-14T06:33:30.143ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 568.93681ms iteration = 29 status = null
34692024-11-14T06:33:30.144ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
34702024-11-14T06:33:30.144ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34712024-11-14T06:33:30.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34722024-11-14T06:33:30.147ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34732024-11-14T06:33:30.148ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
34742024-11-14T06:33:30.148ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34752024-11-14T06:33:30.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34762024-11-14T06:33:30.184ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
34772024-11-14T06:33:30.184ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
34782024-11-14T06:33:30.184ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d0becb58-fa83-49fe-8851-53e4dde39cc5", "date": "Thu, 14 Nov 2024 06:33:30 GMT"} })
34792024-11-14T06:33:30.184ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34802024-11-14T06:33:30.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34812024-11-14T06:33:30.187ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34822024-11-14T06:33:30.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34832024-11-14T06:33:30.189ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 613.969948ms iteration = 29 status = {}
34842024-11-14T06:33:30.189ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34852024-11-14T06:33:30.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34862024-11-14T06:33:30.194ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
34872024-11-14T06:33:30.194ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
34882024-11-14T06:33:30.194ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "f03ae8d0-4311-4910-b094-a2e395e9fe5e", "date": "Thu, 14 Nov 2024 06:33:30 GMT"} })
34892024-11-14T06:33:30.196ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 621.373666ms iteration = 30 status = {}
34902024-11-14T06:33:30.197ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
34912024-11-14T06:33:30.197ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "29c6b411-2bc5-424d-b2fb-a73295a47de6", "date": "Thu, 14 Nov 2024 06:33:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
34922024-11-14T06:33:30.197ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
34932024-11-14T06:33:30.200ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "b2e6c6d7-0237-428b-858b-8473e51e20c4", "date": "Thu, 14 Nov 2024 06:33:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
34942024-11-14T06:33:30.200ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
34952024-11-14T06:33:30.201ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
34962024-11-14T06:33:30.201ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 626.677924ms iteration = 17 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
34972024-11-14T06:33:30.226ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
34982024-11-14T06:33:30.249ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
34992024-11-14T06:33:30.249ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d9d1bb12-20ea-48be-87e0-e99d161a3a07", "content-length": "691", "date": "Thu, 14 Nov 2024 06:33:29 GMT"} })
35002024-11-14T06:33:30.249ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
35012024-11-14T06:33:30.249ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
35022024-11-14T06:33:30.249ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
35032024-11-14T06:33:30.252ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 677.019011ms iteration = 30 status = {}
35042024-11-14T06:33:30.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = eef8ec4f-d02b-46a8-9770-e05f220a2364 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
35052024-11-14T06:33:30.265ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = eef8ec4f-d02b-46a8-9770-e05f220a2364 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
35062024-11-14T06:33:30.266ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1565 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = eef8ec4f-d02b-46a8-9770-e05f220a2364 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
35072024-11-14T06:33:30.285ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35082024-11-14T06:33:30.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35092024-11-14T06:33:30.286ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: cecfafa4-4697-4aa6-949f-23c34aa9d5bd, rack_id: f391bffc-9f2b-4c87-85cd-2718afa7cb93, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(58c91208-be0a-4936-a7c2-2ae07694e16d) } rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
35102024-11-14T06:33:30.286ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35112024-11-14T06:33:30.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35122024-11-14T06:33:30.288ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
35132024-11-14T06:33:30.288ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "311b3be3-da79-490f-920d-2f1cf9eb6e5b", "date": "Thu, 14 Nov 2024 06:33:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
35142024-11-14T06:33:30.288ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
35152024-11-14T06:33:30.290ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "05df05c9-b1b0-400f-9f6d-de77a29eb232", "date": "Thu, 14 Nov 2024 06:33:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
35162024-11-14T06:33:30.290ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
35172024-11-14T06:33:30.292ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "574a8d8f-9f5d-4022-bbc9-d25f1a0bd6fb", "date": "Thu, 14 Nov 2024 06:33:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
35182024-11-14T06:33:30.292ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
35192024-11-14T06:33:30.294ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
35202024-11-14T06:33:30.294ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 719.959951ms iteration = 17 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
35212024-11-14T06:33:30.296ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
35222024-11-14T06:33:30.297ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "7fded62b-7c88-4abb-aef4-c7502a96c98f", "content-length": "134", "date": "Thu, 14 Nov 2024 06:33:29 GMT"} })
35232024-11-14T06:33:30.297ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
35242024-11-14T06:33:30.297ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 58c91208-be0a-4936-a7c2-2ae07694e16d
35252024-11-14T06:33:30.297ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
35262024-11-14T06:33:30.297ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
35272024-11-14T06:33:30.297ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35282024-11-14T06:33:30.297ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35292024-11-14T06:33:30.297ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35302024-11-14T06:33:30.297ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
35312024-11-14T06:33:30.297ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35322024-11-14T06:33:30.297ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
35332024-11-14T06:33:30.297ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
35342024-11-14T06:33:30.297ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35352024-11-14T06:33:30.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35362024-11-14T06:33:30.299ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
35372024-11-14T06:33:30.300ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "6dfd1057-898c-4eb1-aa4c-9a1844a0e47d", "content-length": "2", "date": "Thu, 14 Nov 2024 06:33:29 GMT"} })
35382024-11-14T06:33:30.300ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
35392024-11-14T06:33:30.300ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d0eec24-4866-49fe-968a-6fe0e581bb42", "content-length": "52", "date": "Thu, 14 Nov 2024 06:33:29 GMT"} })
35402024-11-14T06:33:30.300ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
35412024-11-14T06:33:30.300ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
35422024-11-14T06:33:30.401ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "0ce69e93-c624-4588-ab97-b4cfc2e7f9db", "date": "Thu, 14 Nov 2024 06:33:29 GMT"} })
35432024-11-14T06:33:30.401ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch = Switch0
35442024-11-14T06:33:30.401ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
35452024-11-14T06:33:30.402ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2271efe4-1b78-4c8d-961a-cca55cd03b9a", "content-length": "682", "date": "Thu, 14 Nov 2024 06:33:29 GMT"} })
35462024-11-14T06:33:30.402ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35472024-11-14T06:33:30.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35482024-11-14T06:33:30.405ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35492024-11-14T06:33:30.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35502024-11-14T06:33:30.408ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35512024-11-14T06:33:30.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35522024-11-14T06:33:30.411ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35532024-11-14T06:33:30.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35542024-11-14T06:33:30.419ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 844.376036ms iteration = 29 status = {}
35552024-11-14T06:33:31.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = dba7d16f-c873-4a87-bf21-da3682f8286f roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
35562024-11-14T06:33:31.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = dba7d16f-c873-4a87-bf21-da3682f8286f resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
35572024-11-14T06:33:31.288ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2120 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = dba7d16f-c873-4a87-bf21-da3682f8286f response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
35582024-11-14T06:33:32.089ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36021 req_id = a9893792-9870-43fa-a3b1-91b7cd9f5402 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/12?limit=100
35592024-11-14T06:33:32.089ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36021 req_id = a9893792-9870-43fa-a3b1-91b7cd9f5402 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/12?limit=100
35602024-11-14T06:33:32.092ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3366 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36021 req_id = a9893792-9870-43fa-a3b1-91b7cd9f5402 response_code = 200 uri = /nat/ipv4/changeset/12?limit=100
35612024-11-14T06:33:32.310ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 57898d03-1699-4cd9-b98b-f2052cd4b1d5 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
35622024-11-14T06:33:32.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 57898d03-1699-4cd9-b98b-f2052cd4b1d5 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
35632024-11-14T06:33:32.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1767 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 57898d03-1699-4cd9-b98b-f2052cd4b1d5 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
35642024-11-14T06:33:33.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 2aeeb6de-169b-4e05-b912-f35d995e8ff6 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
35652024-11-14T06:33:33.333ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 2aeeb6de-169b-4e05-b912-f35d995e8ff6 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
35662024-11-14T06:33:33.335ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2354 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 2aeeb6de-169b-4e05-b912-f35d995e8ff6 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
35672024-11-14T06:33:34.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 90426c29-2bb3-48b6-951a-99f8f2fdb213 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
35682024-11-14T06:33:34.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 90426c29-2bb3-48b6-951a-99f8f2fdb213 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
35692024-11-14T06:33:34.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2237 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 90426c29-2bb3-48b6-951a-99f8f2fdb213 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
35702024-11-14T06:33:35.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = fac06f8f-ee85-4343-bbba-7caf5fb8aa0a roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
35712024-11-14T06:33:35.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = fac06f8f-ee85-4343-bbba-7caf5fb8aa0a resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
35722024-11-14T06:33:35.383ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2400 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = fac06f8f-ee85-4343-bbba-7caf5fb8aa0a response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
35732024-11-14T06:33:36.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 3ddb91d9-c5e4-46df-a858-4abdfba956f9 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
35742024-11-14T06:33:36.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 3ddb91d9-c5e4-46df-a858-4abdfba956f9 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
35752024-11-14T06:33:36.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2292 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 3ddb91d9-c5e4-46df-a858-4abdfba956f9 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
35762024-11-14T06:33:37.429ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 985d50f7-e357-45bf-bc44-b164ce19276c roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
35772024-11-14T06:33:37.430ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 985d50f7-e357-45bf-bc44-b164ce19276c resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
35782024-11-14T06:33:37.431ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2119 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 985d50f7-e357-45bf-bc44-b164ce19276c response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
35792024-11-14T06:33:37.606ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 611 local_addr = [fd00:1122:3344:101::c]:60882 method = GET remote_addr = [fd00:1122:3344:101::d]:64488 req_id = 4ea1ee2b-7720-4cd3-b222-53091fc3bdcf response_code = 200 uri = /80190dc3-d884-49a0-b9a3-38d31e8c655a
35802024-11-14T06:33:38.453ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 1c9040cd-2be1-43f4-9b11-85bb8b40f3a7 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
35812024-11-14T06:33:38.453ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 1c9040cd-2be1-43f4-9b11-85bb8b40f3a7 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
35822024-11-14T06:33:38.455ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2672 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 1c9040cd-2be1-43f4-9b11-85bb8b40f3a7 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
35832024-11-14T06:33:39.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = a7b6b780-8944-44c0-ae44-8f1e922367ed roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
35842024-11-14T06:33:39.478ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = a7b6b780-8944-44c0-ae44-8f1e922367ed resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
35852024-11-14T06:33:39.479ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2355 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = a7b6b780-8944-44c0-ae44-8f1e922367ed response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
35862024-11-14T06:33:39.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 86 reason = Timeout
35872024-11-14T06:33:39.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 86 reason = Timeout
35882024-11-14T06:33:39.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35892024-11-14T06:33:39.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35902024-11-14T06:33:39.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35912024-11-14T06:33:39.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35922024-11-14T06:33:39.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35932024-11-14T06:33:39.576ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35942024-11-14T06:33:39.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35952024-11-14T06:33:39.577ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.595757ms iteration = 86 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
35962024-11-14T06:33:39.578ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
35972024-11-14T06:33:39.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35982024-11-14T06:33:39.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35992024-11-14T06:33:39.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36002024-11-14T06:33:39.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36012024-11-14T06:33:39.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36022024-11-14T06:33:39.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
36032024-11-14T06:33:39.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36042024-11-14T06:33:39.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36052024-11-14T06:33:39.591ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
36062024-11-14T06:33:39.591ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.422904ms iteration = 86 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
36072024-11-14T06:33:40.500ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = ad2f346e-5c1d-499a-ba1a-637b88bee7b5 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
36082024-11-14T06:33:40.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = ad2f346e-5c1d-499a-ba1a-637b88bee7b5 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
36092024-11-14T06:33:40.502ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2593 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = ad2f346e-5c1d-499a-ba1a-637b88bee7b5 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
36102024-11-14T06:33:41.524ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 69a489e4-9066-46a6-a594-6c186c8febaa roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
36112024-11-14T06:33:41.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 69a489e4-9066-46a6-a594-6c186c8febaa resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
36122024-11-14T06:33:41.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2202 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 69a489e4-9066-46a6-a594-6c186c8febaa response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
36132024-11-14T06:33:42.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = e727750e-4c4d-47b2-b97e-04ba06aa6c3f roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
36142024-11-14T06:33:42.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = e727750e-4c4d-47b2-b97e-04ba06aa6c3f resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
36152024-11-14T06:33:42.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2037 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = e727750e-4c4d-47b2-b97e-04ba06aa6c3f response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
36162024-11-14T06:33:43.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 4bed10a1-2262-4684-9603-c4c6caa0c18c roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
36172024-11-14T06:33:43.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 4bed10a1-2262-4684-9603-c4c6caa0c18c resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
36182024-11-14T06:33:43.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2385 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 4bed10a1-2262-4684-9603-c4c6caa0c18c response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
36192024-11-14T06:33:44.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f69097a9-e367-4cf2-b613-fef5847873d9 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
36202024-11-14T06:33:44.597ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f69097a9-e367-4cf2-b613-fef5847873d9 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
36212024-11-14T06:33:44.599ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2600 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f69097a9-e367-4cf2-b613-fef5847873d9 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
36222024-11-14T06:33:45.619ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = a71e4d6b-b60e-4be3-b538-d2229574377b roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
36232024-11-14T06:33:45.620ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = a71e4d6b-b60e-4be3-b538-d2229574377b resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
36242024-11-14T06:33:45.622ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3092 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = a71e4d6b-b60e-4be3-b538-d2229574377b response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
36252024-11-14T06:33:46.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = a1533674-8053-4bec-85fd-de576c03551b roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
36262024-11-14T06:33:46.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = a1533674-8053-4bec-85fd-de576c03551b resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
36272024-11-14T06:33:46.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2144 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = a1533674-8053-4bec-85fd-de576c03551b response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
36282024-11-14T06:33:47.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 1b418874-892a-4cce-a6bb-9e9bfd6e60c8 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
36292024-11-14T06:33:47.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 1b418874-892a-4cce-a6bb-9e9bfd6e60c8 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
36302024-11-14T06:33:47.670ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2363 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 1b418874-892a-4cce-a6bb-9e9bfd6e60c8 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
36312024-11-14T06:33:48.692ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 5b701812-6396-4fe8-a5bf-6885f9c3f54c roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
36322024-11-14T06:33:48.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 5b701812-6396-4fe8-a5bf-6885f9c3f54c resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
36332024-11-14T06:33:48.694ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2249 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 5b701812-6396-4fe8-a5bf-6885f9c3f54c response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
36342024-11-14T06:33:49.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 87 reason = Timeout
36352024-11-14T06:33:49.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 87 reason = Timeout
36362024-11-14T06:33:49.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36372024-11-14T06:33:49.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36382024-11-14T06:33:49.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36392024-11-14T06:33:49.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36402024-11-14T06:33:49.576ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36412024-11-14T06:33:49.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36422024-11-14T06:33:49.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36432024-11-14T06:33:49.577ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.147328ms iteration = 87 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
36442024-11-14T06:33:49.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
36452024-11-14T06:33:49.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36462024-11-14T06:33:49.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36472024-11-14T06:33:49.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36482024-11-14T06:33:49.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36492024-11-14T06:33:49.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36502024-11-14T06:33:49.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
36512024-11-14T06:33:49.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36522024-11-14T06:33:49.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36532024-11-14T06:33:49.593ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
36542024-11-14T06:33:49.593ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.446374ms iteration = 87 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
36552024-11-14T06:33:49.717ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 2059b37d-35e6-456a-94f4-1d435c8219ca roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
36562024-11-14T06:33:49.717ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 2059b37d-35e6-456a-94f4-1d435c8219ca resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
36572024-11-14T06:33:49.718ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1729 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 2059b37d-35e6-456a-94f4-1d435c8219ca response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
36582024-11-14T06:33:50.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 5c2d8e62-3073-4f38-8007-3aabecbb7ce0 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
36592024-11-14T06:33:50.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 5c2d8e62-3073-4f38-8007-3aabecbb7ce0 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
36602024-11-14T06:33:50.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1871 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 5c2d8e62-3073-4f38-8007-3aabecbb7ce0 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
36612024-11-14T06:33:51.763ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 0f275a29-0f1b-454b-9e74-5a9bdd0ff8f3 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
36622024-11-14T06:33:51.763ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 0f275a29-0f1b-454b-9e74-5a9bdd0ff8f3 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
36632024-11-14T06:33:51.765ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2381 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 0f275a29-0f1b-454b-9e74-5a9bdd0ff8f3 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
36642024-11-14T06:33:52.606ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 809 local_addr = [fd00:1122:3344:101::c]:60882 method = GET remote_addr = [fd00:1122:3344:101::d]:64488 req_id = d8305161-e578-41d0-be00-894b0de45730 response_code = 200 uri = /80190dc3-d884-49a0-b9a3-38d31e8c655a
36652024-11-14T06:33:52.785ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 3f9935cd-130d-4d30-b8a8-80d89fdfc787 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
36662024-11-14T06:33:52.786ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 3f9935cd-130d-4d30-b8a8-80d89fdfc787 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
36672024-11-14T06:33:52.787ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2152 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 3f9935cd-130d-4d30-b8a8-80d89fdfc787 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
36682024-11-14T06:33:53.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 7e5c84b3-16eb-4cf9-8d2b-6ee6b5fc5a3d roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
36692024-11-14T06:33:53.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 7e5c84b3-16eb-4cf9-8d2b-6ee6b5fc5a3d resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
36702024-11-14T06:33:53.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2361 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 7e5c84b3-16eb-4cf9-8d2b-6ee6b5fc5a3d response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
36712024-11-14T06:33:54.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 0692ee5d-b34c-4f4c-af00-ed86e4961eb1 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
36722024-11-14T06:33:54.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 0692ee5d-b34c-4f4c-af00-ed86e4961eb1 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
36732024-11-14T06:33:54.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2388 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 0692ee5d-b34c-4f4c-af00-ed86e4961eb1 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
36742024-11-14T06:33:55.855ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 4df6adb9-1ccf-4d2a-a965-0a9e89d52094 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
36752024-11-14T06:33:55.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 4df6adb9-1ccf-4d2a-a965-0a9e89d52094 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
36762024-11-14T06:33:55.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2048 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 4df6adb9-1ccf-4d2a-a965-0a9e89d52094 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
36772024-11-14T06:33:56.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f3956cf7-46dc-4750-b8e5-832d09dc2bc2 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
36782024-11-14T06:33:56.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f3956cf7-46dc-4750-b8e5-832d09dc2bc2 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
36792024-11-14T06:33:56.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2303 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f3956cf7-46dc-4750-b8e5-832d09dc2bc2 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
36802024-11-14T06:33:57.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f927602e-8c7d-4679-ac77-e3865437c997 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
36812024-11-14T06:33:57.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f927602e-8c7d-4679-ac77-e3865437c997 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
36822024-11-14T06:33:57.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2683 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f927602e-8c7d-4679-ac77-e3865437c997 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
36832024-11-14T06:33:58.925ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 5f44140d-ecd8-48d8-ba57-c70ba109f44d roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
36842024-11-14T06:33:58.926ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 5f44140d-ecd8-48d8-ba57-c70ba109f44d resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
36852024-11-14T06:33:58.928ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2309 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 5f44140d-ecd8-48d8-ba57-c70ba109f44d response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
36862024-11-14T06:33:59.574ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 33 reason = Timeout
36872024-11-14T06:33:59.574ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 30 reason = Timeout
36882024-11-14T06:33:59.574ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36892024-11-14T06:33:59.574ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
36902024-11-14T06:33:59.574ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 30 reason = Timeout
36912024-11-14T06:33:59.574ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
36922024-11-14T06:33:59.574ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36932024-11-14T06:33:59.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 88 reason = Timeout
36942024-11-14T06:33:59.574ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 30 reason = Timeout
36952024-11-14T06:33:59.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36962024-11-14T06:33:59.574ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 31 reason = Timeout
36972024-11-14T06:33:59.574ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36982024-11-14T06:33:59.574ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 30 reason = Timeout
36992024-11-14T06:33:59.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 30 reason = Timeout
37002024-11-14T06:33:59.574ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
37012024-11-14T06:33:59.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 88 reason = Timeout
37022024-11-14T06:33:59.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
37032024-11-14T06:33:59.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37042024-11-14T06:33:59.574ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 30 reason = Timeout
37052024-11-14T06:33:59.574ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 30 reason = Timeout
37062024-11-14T06:33:59.574ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37072024-11-14T06:33:59.574ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
37082024-11-14T06:33:59.574ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 30 reason = Timeout
37092024-11-14T06:33:59.574ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37102024-11-14T06:33:59.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37112024-11-14T06:33:59.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37122024-11-14T06:33:59.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
37132024-11-14T06:33:59.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
37142024-11-14T06:33:59.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37152024-11-14T06:33:59.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
37162024-11-14T06:33:59.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37172024-11-14T06:33:59.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
37182024-11-14T06:33:59.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
37192024-11-14T06:33:59.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37202024-11-14T06:33:59.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37212024-11-14T06:33:59.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 30 reason = Timeout
37222024-11-14T06:33:59.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 30 reason = Timeout
37232024-11-14T06:33:59.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
37242024-11-14T06:33:59.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
37252024-11-14T06:33:59.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 30 reason = Timeout
37262024-11-14T06:33:59.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
37272024-11-14T06:33:59.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 30 reason = Timeout
37282024-11-14T06:33:59.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
37292024-11-14T06:33:59.575ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 31 reason = Timeout
37302024-11-14T06:33:59.575ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
37312024-11-14T06:33:59.575ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37322024-11-14T06:33:59.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
37332024-11-14T06:33:59.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
37342024-11-14T06:33:59.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37352024-11-14T06:33:59.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
37362024-11-14T06:33:59.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
37372024-11-14T06:33:59.577ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37382024-11-14T06:33:59.577ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37392024-11-14T06:33:59.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37402024-11-14T06:33:59.578ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37412024-11-14T06:33:59.578ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.592966ms iteration = 30 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
37422024-11-14T06:33:59.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
37432024-11-14T06:33:59.579ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37442024-11-14T06:33:59.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37452024-11-14T06:33:59.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
37462024-11-14T06:33:59.580ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
37472024-11-14T06:33:59.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
37482024-11-14T06:33:59.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37492024-11-14T06:33:59.582ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37502024-11-14T06:33:59.583ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1896, tv_nsec: 141298951 } })
37512024-11-14T06:33:59.583ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1896, tv_nsec: 141449544 } })
37522024-11-14T06:33:59.583ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
37532024-11-14T06:33:59.583ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
37542024-11-14T06:33:59.584ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37552024-11-14T06:33:59.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
37562024-11-14T06:33:59.584ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37572024-11-14T06:33:59.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37582024-11-14T06:33:59.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37592024-11-14T06:33:59.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37602024-11-14T06:33:59.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37612024-11-14T06:33:59.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
37622024-11-14T06:33:59.588ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37632024-11-14T06:33:59.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37642024-11-14T06:33:59.595ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37652024-11-14T06:33:59.596ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
37662024-11-14T06:33:59.596ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37672024-11-14T06:33:59.596ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 21.525861ms iteration = 30 status = {"errors":[],"records_set_to_done":[]}
37682024-11-14T06:33:59.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37692024-11-14T06:33:59.598ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 23.856764ms iteration = 88 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37702024-11-14T06:33:59.599ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37712024-11-14T06:33:59.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37722024-11-14T06:33:59.600ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37732024-11-14T06:33:59.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37742024-11-14T06:33:59.600ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1896, tv_nsec: 158532452 } })
37752024-11-14T06:33:59.601ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
37762024-11-14T06:33:59.601ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37772024-11-14T06:33:59.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37782024-11-14T06:33:59.601ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
37792024-11-14T06:33:59.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
37802024-11-14T06:33:59.601ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37812024-11-14T06:33:59.603ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
37822024-11-14T06:33:59.603ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37832024-11-14T06:33:59.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37842024-11-14T06:33:59.604ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
37852024-11-14T06:33:59.604ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 30.563229ms iteration = 30 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
37862024-11-14T06:33:59.605ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 30.271724ms iteration = 30 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
37872024-11-14T06:33:59.611ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
37882024-11-14T06:33:59.611ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
37892024-11-14T06:33:59.611ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
37902024-11-14T06:33:59.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
37912024-11-14T06:33:59.621ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
37922024-11-14T06:33:59.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
37932024-11-14T06:33:59.623ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 48.829159ms iteration = 30 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
37942024-11-14T06:33:59.623ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
37952024-11-14T06:33:59.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
37962024-11-14T06:33:59.624ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 49.493461ms iteration = 30 status = {"errors":[],"garbage_collect_requested":[]}
37972024-11-14T06:33:59.625ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37982024-11-14T06:33:59.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37992024-11-14T06:33:59.627ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38002024-11-14T06:33:59.628ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38012024-11-14T06:33:59.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38022024-11-14T06:33:59.629ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
38032024-11-14T06:33:59.629ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38042024-11-14T06:33:59.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38052024-11-14T06:33:59.631ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38062024-11-14T06:33:59.635ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 27a56cb4-44ff-4d5b-931e-1c2c0642844d, lookup_type: ById(27a56cb4-44ff-4d5b-931e-1c2c0642844d) } result = Ok(())
38072024-11-14T06:33:59.635ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38082024-11-14T06:33:59.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38092024-11-14T06:33:59.636ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38102024-11-14T06:33:59.638ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 63.632034ms iteration = 30 status = 0
38112024-11-14T06:33:59.640ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
38122024-11-14T06:33:59.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38132024-11-14T06:33:59.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38142024-11-14T06:33:59.644ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
38152024-11-14T06:33:59.644ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
38162024-11-14T06:33:59.644ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
38172024-11-14T06:33:59.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
38182024-11-14T06:33:59.654ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
38192024-11-14T06:33:59.654ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 80.429617ms iteration = 88 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
38202024-11-14T06:33:59.666ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
38212024-11-14T06:33:59.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
38222024-11-14T06:33:59.671ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
38232024-11-14T06:33:59.671ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
38242024-11-14T06:33:59.671ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "32def50f-8447-4e06-82f0-5663692666d0", "content-length": "26", "date": "Thu, 14 Nov 2024 06:33:59 GMT"} })
38252024-11-14T06:33:59.672ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
38262024-11-14T06:33:59.674ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
38272024-11-14T06:33:59.682ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
38282024-11-14T06:33:59.682ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
38292024-11-14T06:33:59.682ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d7746d5-fe30-49aa-a41c-33f85f2889b5", "content-length": "26", "date": "Thu, 14 Nov 2024 06:33:59 GMT"} })
38302024-11-14T06:33:59.682ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
38312024-11-14T06:33:59.687ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
38322024-11-14T06:33:59.693ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
38332024-11-14T06:33:59.693ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
38342024-11-14T06:33:59.693ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 119.547485ms iteration = 30 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
38352024-11-14T06:33:59.699ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 zone_address = fd00:1122:3344:101::2
38362024-11-14T06:33:59.699ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
38372024-11-14T06:33:59.699ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "345af19a-15f3-478d-8845-c8235cf0aa80", "content-length": "26", "date": "Thu, 14 Nov 2024 06:33:59 GMT"} })
38382024-11-14T06:33:59.699ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
38392024-11-14T06:33:59.701ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
38402024-11-14T06:33:59.701ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 126.451874ms iteration = 30 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
38412024-11-14T06:33:59.707ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38422024-11-14T06:33:59.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38432024-11-14T06:33:59.722ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 147.977904ms iteration = 33 status = {"physical_disks_added":0}
38442024-11-14T06:33:59.776ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 201.861518ms iteration = 30 status = {}
38452024-11-14T06:33:59.796ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
38462024-11-14T06:33:59.796ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e5ce0e12-d705-48ff-a453-ecdfedbc50f0", "content-length": "2", "date": "Thu, 14 Nov 2024 06:33:59 GMT"} })
38472024-11-14T06:33:59.797ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
38482024-11-14T06:33:59.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
38492024-11-14T06:33:59.873ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
38502024-11-14T06:33:59.873ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
38512024-11-14T06:33:59.873ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d9456ce0-e224-4724-a22b-4c865ed04a54", "content-length": "372", "date": "Thu, 14 Nov 2024 06:33:59 GMT"} })
38522024-11-14T06:33:59.873ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38532024-11-14T06:33:59.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38542024-11-14T06:33:59.875ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 301.647024ms iteration = 30 status = null
38552024-11-14T06:33:59.889ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
38562024-11-14T06:33:59.889ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
38572024-11-14T06:33:59.889ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a0aa2669-b70d-40e0-8e64-0b373cf69f43", "date": "Thu, 14 Nov 2024 06:33:59 GMT"} })
38582024-11-14T06:33:59.889ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38592024-11-14T06:33:59.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38602024-11-14T06:33:59.892ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38612024-11-14T06:33:59.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38622024-11-14T06:33:59.895ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38632024-11-14T06:33:59.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38642024-11-14T06:33:59.898ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
38652024-11-14T06:33:59.898ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
38662024-11-14T06:33:59.898ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e3ed7be7-b292-43d5-90be-a1ac2ad50cd2", "date": "Thu, 14 Nov 2024 06:33:59 GMT"} })
38672024-11-14T06:33:59.901ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 325.655462ms iteration = 31 status = {}
38682024-11-14T06:33:59.935ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38692024-11-14T06:33:59.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38702024-11-14T06:33:59.937ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: cecfafa4-4697-4aa6-949f-23c34aa9d5bd, rack_id: f391bffc-9f2b-4c87-85cd-2718afa7cb93, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(58c91208-be0a-4936-a7c2-2ae07694e16d) } rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
38712024-11-14T06:33:59.937ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38722024-11-14T06:33:59.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38732024-11-14T06:33:59.945ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
38742024-11-14T06:33:59.945ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "79f0be7e-31fb-43f9-b6ef-15c4de314b57", "content-length": "134", "date": "Thu, 14 Nov 2024 06:33:59 GMT"} })
38752024-11-14T06:33:59.945ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
38762024-11-14T06:33:59.945ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 58c91208-be0a-4936-a7c2-2ae07694e16d
38772024-11-14T06:33:59.945ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
38782024-11-14T06:33:59.945ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
38792024-11-14T06:33:59.945ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38802024-11-14T06:33:59.945ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38812024-11-14T06:33:59.945ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38822024-11-14T06:33:59.945ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
38832024-11-14T06:33:59.945ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38842024-11-14T06:33:59.945ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
38852024-11-14T06:33:59.945ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
38862024-11-14T06:33:59.946ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38872024-11-14T06:33:59.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38882024-11-14T06:33:59.948ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
38892024-11-14T06:33:59.948ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "45c96db1-c686-4969-848e-0668e2366de2", "content-length": "2", "date": "Thu, 14 Nov 2024 06:33:59 GMT"} })
38902024-11-14T06:33:59.948ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
38912024-11-14T06:33:59.948ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "88a0f3d7-ad36-4945-ab18-f163ccf5e0b0", "content-length": "52", "date": "Thu, 14 Nov 2024 06:33:59 GMT"} })
38922024-11-14T06:33:59.948ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
38932024-11-14T06:33:59.948ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
38942024-11-14T06:33:59.963ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38952024-11-14T06:33:59.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38962024-11-14T06:33:59.965ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38972024-11-14T06:33:59.966ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
38982024-11-14T06:33:59.966ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38992024-11-14T06:33:59.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39002024-11-14T06:33:59.968ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39012024-11-14T06:33:59.970ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
39022024-11-14T06:33:59.970ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39032024-11-14T06:33:59.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39042024-11-14T06:34:00.002ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
39052024-11-14T06:34:00.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 19d0ab57-da64-469f-b412-35ee8d1a1dbf roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
39062024-11-14T06:34:00.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 19d0ab57-da64-469f-b412-35ee8d1a1dbf resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
39072024-11-14T06:34:00.027ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "79b150cb-4770-45dc-8704-fd532d5bf440", "content-length": "691", "date": "Thu, 14 Nov 2024 06:33:59 GMT"} })
39082024-11-14T06:34:00.027ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
39092024-11-14T06:34:00.027ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
39102024-11-14T06:34:00.027ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
39112024-11-14T06:34:00.028ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 453.92765ms iteration = 31 status = {}
39122024-11-14T06:34:00.029ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2773 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 19d0ab57-da64-469f-b412-35ee8d1a1dbf response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
39132024-11-14T06:34:00.130ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "c648c3b9-60e8-42b0-ac6d-f6586e018b15", "date": "Thu, 14 Nov 2024 06:33:59 GMT"} })
39142024-11-14T06:34:00.130ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch = Switch0
39152024-11-14T06:34:00.130ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
39162024-11-14T06:34:00.130ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2fa6d162-98fe-4cbf-af60-57a2bc5a1028", "content-length": "682", "date": "Thu, 14 Nov 2024 06:33:59 GMT"} })
39172024-11-14T06:34:00.130ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39182024-11-14T06:34:00.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39192024-11-14T06:34:00.134ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39202024-11-14T06:34:00.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39212024-11-14T06:34:00.138ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39222024-11-14T06:34:00.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39232024-11-14T06:34:00.140ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39242024-11-14T06:34:00.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39252024-11-14T06:34:00.147ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 572.875173ms iteration = 30 status = {}
39262024-11-14T06:34:01.053ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = afb0d94e-0441-492a-9754-cdb87917ab3d roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
39272024-11-14T06:34:01.053ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = afb0d94e-0441-492a-9754-cdb87917ab3d resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
39282024-11-14T06:34:01.055ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2198 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = afb0d94e-0441-492a-9754-cdb87917ab3d response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
39292024-11-14T06:34:02.078ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 12786ba5-6d2e-4432-ab74-eaaad9246b27 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
39302024-11-14T06:34:02.078ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 12786ba5-6d2e-4432-ab74-eaaad9246b27 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
39312024-11-14T06:34:02.081ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2653 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 12786ba5-6d2e-4432-ab74-eaaad9246b27 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
39322024-11-14T06:34:02.124ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36021 req_id = dd0a86f1-7892-44a2-b95d-35066121585f roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/12?limit=100
39332024-11-14T06:34:02.124ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36021 req_id = dd0a86f1-7892-44a2-b95d-35066121585f resource = Database result = Ok(()) uri = /nat/ipv4/changeset/12?limit=100
39342024-11-14T06:34:02.127ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3529 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36021 req_id = dd0a86f1-7892-44a2-b95d-35066121585f response_code = 200 uri = /nat/ipv4/changeset/12?limit=100
39352024-11-14T06:34:03.102ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = db3fe571-4169-40ff-bd91-fa9589b733c0 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
39362024-11-14T06:34:03.103ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = db3fe571-4169-40ff-bd91-fa9589b733c0 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
39372024-11-14T06:34:03.105ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2287 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = db3fe571-4169-40ff-bd91-fa9589b733c0 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
39382024-11-14T06:34:04.126ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 5018688d-807b-4b98-9213-d75398a8c286 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
39392024-11-14T06:34:04.126ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 5018688d-807b-4b98-9213-d75398a8c286 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
39402024-11-14T06:34:04.128ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2486 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 5018688d-807b-4b98-9213-d75398a8c286 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
39412024-11-14T06:34:05.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = e1d7edc9-43f8-4ede-a79a-148cf7ace487 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
39422024-11-14T06:34:05.151ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = e1d7edc9-43f8-4ede-a79a-148cf7ace487 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
39432024-11-14T06:34:05.153ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2010 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = e1d7edc9-43f8-4ede-a79a-148cf7ace487 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
39442024-11-14T06:34:06.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = bef755bd-6a81-4bde-bbfb-6449eca9e2e4 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
39452024-11-14T06:34:06.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = bef755bd-6a81-4bde-bbfb-6449eca9e2e4 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
39462024-11-14T06:34:06.177ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2293 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = bef755bd-6a81-4bde-bbfb-6449eca9e2e4 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
39472024-11-14T06:34:07.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 2b6d9d20-6e1f-4cca-ae47-861f653dd677 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
39482024-11-14T06:34:07.199ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 2b6d9d20-6e1f-4cca-ae47-861f653dd677 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
39492024-11-14T06:34:07.201ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2446 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 2b6d9d20-6e1f-4cca-ae47-861f653dd677 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
39502024-11-14T06:34:07.605ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 569 local_addr = [fd00:1122:3344:101::c]:60882 method = GET remote_addr = [fd00:1122:3344:101::d]:64488 req_id = 5602a3c1-b240-4411-9e36-bddc7983f269 response_code = 200 uri = /80190dc3-d884-49a0-b9a3-38d31e8c655a
39512024-11-14T06:34:08.224ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = cd9ab329-b925-481d-84f4-14b6ef4da29d roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
39522024-11-14T06:34:08.224ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = cd9ab329-b925-481d-84f4-14b6ef4da29d resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
39532024-11-14T06:34:08.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2255 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = cd9ab329-b925-481d-84f4-14b6ef4da29d response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
39542024-11-14T06:34:09.247ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = a0919b15-6afc-4478-90d6-fd37231d745f roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
39552024-11-14T06:34:09.248ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = a0919b15-6afc-4478-90d6-fd37231d745f resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
39562024-11-14T06:34:09.250ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2447 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = a0919b15-6afc-4478-90d6-fd37231d745f response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
39572024-11-14T06:34:09.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 89 reason = Timeout
39582024-11-14T06:34:09.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39592024-11-14T06:34:09.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 89 reason = Timeout
39602024-11-14T06:34:09.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39612024-11-14T06:34:09.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39622024-11-14T06:34:09.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39632024-11-14T06:34:09.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39642024-11-14T06:34:09.577ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39652024-11-14T06:34:09.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39662024-11-14T06:34:09.578ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.832652ms iteration = 89 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39672024-11-14T06:34:09.578ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39682024-11-14T06:34:09.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39692024-11-14T06:34:09.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39702024-11-14T06:34:09.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39712024-11-14T06:34:09.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39722024-11-14T06:34:09.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39732024-11-14T06:34:09.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
39742024-11-14T06:34:09.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39752024-11-14T06:34:09.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39762024-11-14T06:34:09.596ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
39772024-11-14T06:34:09.596ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.733895ms iteration = 89 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
39782024-11-14T06:34:10.272ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 8511676f-4a6a-488d-8339-0df5ae5ae087 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
39792024-11-14T06:34:10.273ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 8511676f-4a6a-488d-8339-0df5ae5ae087 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
39802024-11-14T06:34:10.274ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2486 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 8511676f-4a6a-488d-8339-0df5ae5ae087 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
39812024-11-14T06:34:11.295ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 6d989a8d-4d97-4b20-99f0-018a3b3ccbc3 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
39822024-11-14T06:34:11.296ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 6d989a8d-4d97-4b20-99f0-018a3b3ccbc3 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
39832024-11-14T06:34:11.297ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2206 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 6d989a8d-4d97-4b20-99f0-018a3b3ccbc3 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
39842024-11-14T06:34:12.319ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 0b670821-ba0c-4b21-b399-5d816c9d26c2 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
39852024-11-14T06:34:12.319ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 0b670821-ba0c-4b21-b399-5d816c9d26c2 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
39862024-11-14T06:34:12.321ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2105 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 0b670821-ba0c-4b21-b399-5d816c9d26c2 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
39872024-11-14T06:34:13.343ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = dd4fc465-9a95-4797-8697-401d014f500f roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
39882024-11-14T06:34:13.343ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = dd4fc465-9a95-4797-8697-401d014f500f resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
39892024-11-14T06:34:13.345ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2582 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = dd4fc465-9a95-4797-8697-401d014f500f response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
39902024-11-14T06:34:14.365ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = df7e2ec7-6476-4bf2-900b-99db4301b25a roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
39912024-11-14T06:34:14.365ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = df7e2ec7-6476-4bf2-900b-99db4301b25a resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
39922024-11-14T06:34:14.367ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2381 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = df7e2ec7-6476-4bf2-900b-99db4301b25a response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
39932024-11-14T06:34:15.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 036ebd37-620d-46f0-bf12-0662366579ef roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
39942024-11-14T06:34:15.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 036ebd37-620d-46f0-bf12-0662366579ef resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
39952024-11-14T06:34:15.391ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2295 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 036ebd37-620d-46f0-bf12-0662366579ef response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
39962024-11-14T06:34:16.413ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 47e55123-1571-41ab-9f6d-9eb9bdcc1e77 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
39972024-11-14T06:34:16.414ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 47e55123-1571-41ab-9f6d-9eb9bdcc1e77 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
39982024-11-14T06:34:16.415ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2151 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 47e55123-1571-41ab-9f6d-9eb9bdcc1e77 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
39992024-11-14T06:34:17.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 611182e4-3d00-4228-9cb8-57c66f66e039 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
40002024-11-14T06:34:17.438ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 611182e4-3d00-4228-9cb8-57c66f66e039 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
40012024-11-14T06:34:17.440ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2675 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 611182e4-3d00-4228-9cb8-57c66f66e039 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
40022024-11-14T06:34:18.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 00fa4ade-8ce0-4f96-95a5-dad2a11b9927 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
40032024-11-14T06:34:18.462ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 00fa4ade-8ce0-4f96-95a5-dad2a11b9927 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
40042024-11-14T06:34:18.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2460 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 00fa4ade-8ce0-4f96-95a5-dad2a11b9927 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
40052024-11-14T06:34:19.486ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 40f06f40-9cf1-49cd-95ae-16dbd964e806 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
40062024-11-14T06:34:19.486ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 40f06f40-9cf1-49cd-95ae-16dbd964e806 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
40072024-11-14T06:34:19.487ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1944 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 40f06f40-9cf1-49cd-95ae-16dbd964e806 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
40082024-11-14T06:34:19.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 90 reason = Timeout
40092024-11-14T06:34:19.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 90 reason = Timeout
40102024-11-14T06:34:19.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40112024-11-14T06:34:19.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40122024-11-14T06:34:19.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40132024-11-14T06:34:19.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40142024-11-14T06:34:19.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40152024-11-14T06:34:19.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40162024-11-14T06:34:19.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40172024-11-14T06:34:19.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40182024-11-14T06:34:19.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40192024-11-14T06:34:19.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40202024-11-14T06:34:19.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40212024-11-14T06:34:19.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40222024-11-14T06:34:19.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40232024-11-14T06:34:19.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
40242024-11-14T06:34:19.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40252024-11-14T06:34:19.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40262024-11-14T06:34:19.596ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
40272024-11-14T06:34:19.596ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.323045ms iteration = 90 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
40282024-11-14T06:34:19.610ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.01069ms iteration = 90 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
40292024-11-14T06:34:20.509ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 1dfd7cb2-6748-4e27-8b0c-7e1de395148b roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
40302024-11-14T06:34:20.509ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 1dfd7cb2-6748-4e27-8b0c-7e1de395148b resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
40312024-11-14T06:34:20.511ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1877 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 1dfd7cb2-6748-4e27-8b0c-7e1de395148b response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
40322024-11-14T06:34:21.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f4fd2166-19a2-4f9b-9e02-b5e038b55a44 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
40332024-11-14T06:34:21.533ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f4fd2166-19a2-4f9b-9e02-b5e038b55a44 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
40342024-11-14T06:34:21.535ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2359 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f4fd2166-19a2-4f9b-9e02-b5e038b55a44 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
40352024-11-14T06:34:22.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = af34f58c-137a-490c-95c4-889ec12c69e6 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
40362024-11-14T06:34:22.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = af34f58c-137a-490c-95c4-889ec12c69e6 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
40372024-11-14T06:34:22.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2546 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = af34f58c-137a-490c-95c4-889ec12c69e6 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
40382024-11-14T06:34:22.605ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 701 local_addr = [fd00:1122:3344:101::c]:60882 method = GET remote_addr = [fd00:1122:3344:101::d]:64488 req_id = a2607506-e9f1-489f-9829-85906b910f58 response_code = 200 uri = /80190dc3-d884-49a0-b9a3-38d31e8c655a
40392024-11-14T06:34:23.580ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = b79b0052-6401-4b2b-ad70-bc09dd3be0ea roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
40402024-11-14T06:34:23.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = b79b0052-6401-4b2b-ad70-bc09dd3be0ea resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
40412024-11-14T06:34:23.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2498 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = b79b0052-6401-4b2b-ad70-bc09dd3be0ea response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
40422024-11-14T06:34:24.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = c223b285-d3db-4c4c-bfa6-edcd5625337a roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
40432024-11-14T06:34:24.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = c223b285-d3db-4c4c-bfa6-edcd5625337a resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
40442024-11-14T06:34:24.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2305 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = c223b285-d3db-4c4c-bfa6-edcd5625337a response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
40452024-11-14T06:34:25.626ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 6a1c74bc-dae4-4b60-a129-a4a13ece115b roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
40462024-11-14T06:34:25.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 6a1c74bc-dae4-4b60-a129-a4a13ece115b resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
40472024-11-14T06:34:25.628ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2089 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 6a1c74bc-dae4-4b60-a129-a4a13ece115b response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
40482024-11-14T06:34:26.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 669a1667-49cb-4d01-92c5-e53e62fc1059 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
40492024-11-14T06:34:26.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 669a1667-49cb-4d01-92c5-e53e62fc1059 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
40502024-11-14T06:34:26.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2316 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 669a1667-49cb-4d01-92c5-e53e62fc1059 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
40512024-11-14T06:34:27.672ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 27e39c39-5a8b-4544-b186-f00af786ba1d roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
40522024-11-14T06:34:27.672ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 27e39c39-5a8b-4544-b186-f00af786ba1d resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
40532024-11-14T06:34:27.674ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2139 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 27e39c39-5a8b-4544-b186-f00af786ba1d response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
40542024-11-14T06:34:28.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 19e4a626-c002-4028-ad3b-0117924a287f roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
40552024-11-14T06:34:28.696ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 19e4a626-c002-4028-ad3b-0117924a287f resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
40562024-11-14T06:34:28.698ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2367 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 19e4a626-c002-4028-ad3b-0117924a287f response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
40572024-11-14T06:34:29.574ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 31 reason = Timeout
40582024-11-14T06:34:29.574ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40592024-11-14T06:34:29.574ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 34 reason = Timeout
40602024-11-14T06:34:29.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 31 reason = Timeout
40612024-11-14T06:34:29.574ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40622024-11-14T06:34:29.574ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 31 reason = Timeout
40632024-11-14T06:34:29.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
40642024-11-14T06:34:29.574ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40652024-11-14T06:34:29.574ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 31 reason = Timeout
40662024-11-14T06:34:29.574ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 32 reason = Timeout
40672024-11-14T06:34:29.574ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40682024-11-14T06:34:29.574ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
40692024-11-14T06:34:29.574ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 31 reason = Timeout
40702024-11-14T06:34:29.574ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
40712024-11-14T06:34:29.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 91 reason = Timeout
40722024-11-14T06:34:29.574ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 18 reason = Timeout
40732024-11-14T06:34:29.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40742024-11-14T06:34:29.574ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 7 reason = Timeout
40752024-11-14T06:34:29.574ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 16 reason = Timeout
40762024-11-14T06:34:29.574ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40772024-11-14T06:34:29.574ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
40782024-11-14T06:34:29.574ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40792024-11-14T06:34:29.574ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 16 reason = Timeout
40802024-11-14T06:34:29.574ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40812024-11-14T06:34:29.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 17 reason = Timeout
40822024-11-14T06:34:29.574ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 1d98d624-72d4-4466-8fe7-990461a3f886
40832024-11-14T06:34:29.574ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 31 reason = Timeout
40842024-11-14T06:34:29.574ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 16.63\u{b5}s iteration = 17 status = {"enabled":false,"target_id":"1d98d624-72d4-4466-8fe7-990461a3f886"}
40852024-11-14T06:34:29.574ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 16 reason = Timeout
40862024-11-14T06:34:29.574ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 16 reason = Timeout
40872024-11-14T06:34:29.574ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 06:24:29.574729306 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
40882024-11-14T06:34:29.574ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
40892024-11-14T06:34:29.574ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
40902024-11-14T06:34:29.574ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 16 reason = Timeout
40912024-11-14T06:34:29.574ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
40922024-11-14T06:34:29.574ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 16 reason = Timeout
40932024-11-14T06:34:29.574ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40942024-11-14T06:34:29.574ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
40952024-11-14T06:34:29.574ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 18 reason = Timeout
40962024-11-14T06:34:29.574ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
40972024-11-14T06:34:29.574ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 16 reason = Timeout
40982024-11-14T06:34:29.574ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 31 reason = Timeout
40992024-11-14T06:34:29.574ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
41002024-11-14T06:34:29.574ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
41012024-11-14T06:34:29.574ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 16 reason = Timeout
41022024-11-14T06:34:29.575ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 31 reason = Timeout
41032024-11-14T06:34:29.575ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
41042024-11-14T06:34:29.575ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 91 reason = Timeout
41052024-11-14T06:34:29.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41062024-11-14T06:34:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41072024-11-14T06:34:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41082024-11-14T06:34:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41092024-11-14T06:34:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41102024-11-14T06:34:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
41112024-11-14T06:34:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
41122024-11-14T06:34:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41132024-11-14T06:34:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
41142024-11-14T06:34:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41152024-11-14T06:34:29.575ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41162024-11-14T06:34:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41172024-11-14T06:34:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
41182024-11-14T06:34:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
41192024-11-14T06:34:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
41202024-11-14T06:34:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41212024-11-14T06:34:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
41222024-11-14T06:34:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41232024-11-14T06:34:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
41242024-11-14T06:34:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41252024-11-14T06:34:29.575ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 32 reason = Timeout
41262024-11-14T06:34:29.575ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
41272024-11-14T06:34:29.575ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 4 reason = Timeout
41282024-11-14T06:34:29.575ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
41292024-11-14T06:34:29.575ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41302024-11-14T06:34:29.575ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41312024-11-14T06:34:29.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 31 reason = Timeout
41322024-11-14T06:34:29.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
41332024-11-14T06:34:29.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 31 reason = Timeout
41342024-11-14T06:34:29.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
41352024-11-14T06:34:29.575ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 16 reason = Timeout
41362024-11-14T06:34:29.575ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
41372024-11-14T06:34:29.575ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 16 reason = Timeout
41382024-11-14T06:34:29.575ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
41392024-11-14T06:34:29.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 31 reason = Timeout
41402024-11-14T06:34:29.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
41412024-11-14T06:34:29.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 31 reason = Timeout
41422024-11-14T06:34:29.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
41432024-11-14T06:34:29.575ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("720ac48b-8596-4763-a661-482d124c0a16.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f40de7f6-4bc1-4578-baeb-b08e777b4bed.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f40de7f6-4bc1-4578-baeb-b08e777b4bed.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1926, tv_nsec: 133476066 } })
41442024-11-14T06:34:29.575ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("36c202a9-b541-4083-88f5-ff6483340b34.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("78c1624f-34e7-40fb-a468-bb6354445b73.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d40cb6d7-78a4-49d0-ae26-45907e21e06a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d40cb6d7-78a4-49d0-ae26-45907e21e06a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1926, tv_nsec: 133479796 } })
41452024-11-14T06:34:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41462024-11-14T06:34:29.575ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41472024-11-14T06:34:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
41482024-11-14T06:34:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
41492024-11-14T06:34:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41502024-11-14T06:34:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
41512024-11-14T06:34:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
41522024-11-14T06:34:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
41532024-11-14T06:34:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
41542024-11-14T06:34:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41552024-11-14T06:34:29.575ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41562024-11-14T06:34:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41572024-11-14T06:34:29.576ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
41582024-11-14T06:34:29.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41592024-11-14T06:34:29.576ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41602024-11-14T06:34:29.576ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.348896ms iteration = 16 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
41612024-11-14T06:34:29.576ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
41622024-11-14T06:34:29.576ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.438117ms iteration = 16 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
41632024-11-14T06:34:29.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41642024-11-14T06:34:29.578ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41652024-11-14T06:34:29.578ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41662024-11-14T06:34:29.579ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41672024-11-14T06:34:29.580ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.308769ms iteration = 31 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
41682024-11-14T06:34:29.581ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
41692024-11-14T06:34:29.581ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41702024-11-14T06:34:29.581ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
41712024-11-14T06:34:29.581ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41722024-11-14T06:34:29.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41732024-11-14T06:34:29.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41742024-11-14T06:34:29.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
41752024-11-14T06:34:29.583ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41762024-11-14T06:34:29.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41772024-11-14T06:34:29.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41782024-11-14T06:34:29.584ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1926, tv_nsec: 142506104 } })
41792024-11-14T06:34:29.585ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
41802024-11-14T06:34:29.585ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41812024-11-14T06:34:29.586ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41822024-11-14T06:34:29.586ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1926, tv_nsec: 144752176 } })
41832024-11-14T06:34:29.587ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
41842024-11-14T06:34:29.589ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
41852024-11-14T06:34:29.589ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41862024-11-14T06:34:29.589ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
41872024-11-14T06:34:29.589ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41882024-11-14T06:34:29.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41892024-11-14T06:34:29.589ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
41902024-11-14T06:34:29.589ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41912024-11-14T06:34:29.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41922024-11-14T06:34:29.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41932024-11-14T06:34:29.591ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41942024-11-14T06:34:29.594ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
41952024-11-14T06:34:29.594ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
41962024-11-14T06:34:29.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
41972024-11-14T06:34:29.596ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41982024-11-14T06:34:29.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41992024-11-14T06:34:29.597ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42002024-11-14T06:34:29.597ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42012024-11-14T06:34:29.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42022024-11-14T06:34:29.600ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
42032024-11-14T06:34:29.600ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
42042024-11-14T06:34:29.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
42052024-11-14T06:34:29.601ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 06:24:29.574729306 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
42062024-11-14T06:34:29.601ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 26.374411ms iteration = 16 status = {"expiration":"2024-11-14T06:24:29.574729306Z","pruned":[]}
42072024-11-14T06:34:29.605ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42082024-11-14T06:34:29.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42092024-11-14T06:34:29.606ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 30.987167ms iteration = 31 status = {"errors":[],"garbage_collect_requested":[]}
42102024-11-14T06:34:29.607ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 32.312611ms iteration = 16 status = {"errors":[],"found_port_ok":[]}
42112024-11-14T06:34:29.608ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42122024-11-14T06:34:29.609ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42132024-11-14T06:34:29.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
42142024-11-14T06:34:29.612ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42152024-11-14T06:34:29.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
42162024-11-14T06:34:29.613ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
42172024-11-14T06:34:29.613ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42182024-11-14T06:34:29.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42192024-11-14T06:34:29.619ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42202024-11-14T06:34:29.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42212024-11-14T06:34:29.620ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1926, tv_nsec: 178186278 } })
42222024-11-14T06:34:29.620ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
42232024-11-14T06:34:29.620ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42242024-11-14T06:34:29.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42252024-11-14T06:34:29.624ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42262024-11-14T06:34:29.624ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42272024-11-14T06:34:29.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42282024-11-14T06:34:29.624ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42292024-11-14T06:34:29.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
42302024-11-14T06:34:29.628ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
42312024-11-14T06:34:29.639ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
42322024-11-14T06:34:29.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
42332024-11-14T06:34:29.643ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
42342024-11-14T06:34:29.643ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
42352024-11-14T06:34:29.643ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
42362024-11-14T06:34:29.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
42372024-11-14T06:34:29.643ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42382024-11-14T06:34:29.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42392024-11-14T06:34:29.648ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
42402024-11-14T06:34:29.648ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 73.899705ms iteration = 31 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
42412024-11-14T06:34:29.649ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42422024-11-14T06:34:29.653ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
42432024-11-14T06:34:29.653ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42442024-11-14T06:34:29.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42452024-11-14T06:34:29.654ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42462024-11-14T06:34:29.654ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
42472024-11-14T06:34:29.654ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
42482024-11-14T06:34:29.654ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 78.96831ms iteration = 16 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
42492024-11-14T06:34:29.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42502024-11-14T06:34:29.656ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42512024-11-14T06:34:29.656ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42522024-11-14T06:34:29.658ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
42532024-11-14T06:34:29.658ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
42542024-11-14T06:34:29.658ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
42552024-11-14T06:34:29.658ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
42562024-11-14T06:34:29.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
42572024-11-14T06:34:29.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
42582024-11-14T06:34:29.659ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
42592024-11-14T06:34:29.659ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42602024-11-14T06:34:29.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42612024-11-14T06:34:29.660ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42622024-11-14T06:34:29.661ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
42632024-11-14T06:34:29.661ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42642024-11-14T06:34:29.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
42652024-11-14T06:34:29.662ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
42662024-11-14T06:34:29.663ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 87.519729ms iteration = 31 status = {"errors":[],"records_set_to_done":[]}
42672024-11-14T06:34:29.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
42682024-11-14T06:34:29.663ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
42692024-11-14T06:34:29.663ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42702024-11-14T06:34:29.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
42712024-11-14T06:34:29.664ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42722024-11-14T06:34:29.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42732024-11-14T06:34:29.665ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42742024-11-14T06:34:29.666ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42752024-11-14T06:34:29.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42762024-11-14T06:34:29.667ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
42772024-11-14T06:34:29.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
42782024-11-14T06:34:29.669ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
42792024-11-14T06:34:29.669ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42802024-11-14T06:34:29.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
42812024-11-14T06:34:29.671ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 96.18955ms iteration = 31 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
42822024-11-14T06:34:29.672ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 98.009054ms iteration = 91 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42832024-11-14T06:34:29.673ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42842024-11-14T06:34:29.673ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42852024-11-14T06:34:29.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42862024-11-14T06:34:29.676ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
42872024-11-14T06:34:29.676ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42882024-11-14T06:34:29.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
42892024-11-14T06:34:29.679ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42902024-11-14T06:34:29.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42912024-11-14T06:34:29.679ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 105.164027ms iteration = 7 status = {"nsuccess":5}
42922024-11-14T06:34:29.680ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42932024-11-14T06:34:29.681ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
42942024-11-14T06:34:29.681ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
42952024-11-14T06:34:29.681ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 106.593074ms iteration = 16 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
42962024-11-14T06:34:29.681ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42972024-11-14T06:34:29.681ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42982024-11-14T06:34:29.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42992024-11-14T06:34:29.686ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
43002024-11-14T06:34:29.686ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
43012024-11-14T06:34:29.686ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43022024-11-14T06:34:29.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43032024-11-14T06:34:29.689ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43042024-11-14T06:34:29.689ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43052024-11-14T06:34:29.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43062024-11-14T06:34:29.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43072024-11-14T06:34:29.690ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43082024-11-14T06:34:29.693ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
43092024-11-14T06:34:29.693ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43102024-11-14T06:34:29.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43112024-11-14T06:34:29.695ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
43122024-11-14T06:34:29.695ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
43132024-11-14T06:34:29.695ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
43142024-11-14T06:34:29.695ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43152024-11-14T06:34:29.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43162024-11-14T06:34:29.699ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 125.188521ms iteration = 31 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
43172024-11-14T06:34:29.702ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
43182024-11-14T06:34:29.702ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
43192024-11-14T06:34:29.702ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 127.973162ms iteration = 31 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
43202024-11-14T06:34:29.703ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
43212024-11-14T06:34:29.704ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
43222024-11-14T06:34:29.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
43232024-11-14T06:34:29.706ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
43242024-11-14T06:34:29.706ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 132.327553ms iteration = 91 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
43252024-11-14T06:34:29.707ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43262024-11-14T06:34:29.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43272024-11-14T06:34:29.710ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43282024-11-14T06:34:29.711ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
43292024-11-14T06:34:29.711ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43302024-11-14T06:34:29.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43312024-11-14T06:34:29.721ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = ccfbe451-a3b9-43f2-8a42-b8ae0a0dbb3b roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
43322024-11-14T06:34:29.721ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = ccfbe451-a3b9-43f2-8a42-b8ae0a0dbb3b resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
43332024-11-14T06:34:29.723ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 148.028365ms iteration = 31 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
43342024-11-14T06:34:29.724ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3201 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = ccfbe451-a3b9-43f2-8a42-b8ae0a0dbb3b response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
43352024-11-14T06:34:29.724ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
43362024-11-14T06:34:29.724ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
43372024-11-14T06:34:29.724ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
43382024-11-14T06:34:29.724ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43392024-11-14T06:34:29.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43402024-11-14T06:34:29.726ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43412024-11-14T06:34:29.730ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
43422024-11-14T06:34:29.730ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43432024-11-14T06:34:29.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43442024-11-14T06:34:29.731ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43452024-11-14T06:34:29.733ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
43462024-11-14T06:34:29.733ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = c6d59938-b455-4e7b-9d17-0d6427a65b9c dns_zone_name = oxide.test found_so_far = 0 version = 2
43472024-11-14T06:34:29.733ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43482024-11-14T06:34:29.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43492024-11-14T06:34:29.734ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43502024-11-14T06:34:29.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 27a56cb4-44ff-4d5b-931e-1c2c0642844d, lookup_type: ById(27a56cb4-44ff-4d5b-931e-1c2c0642844d) } result = Ok(())
43512024-11-14T06:34:29.735ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43522024-11-14T06:34:29.735ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43532024-11-14T06:34:29.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43542024-11-14T06:34:29.737ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
43552024-11-14T06:34:29.737ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43562024-11-14T06:34:29.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43572024-11-14T06:34:29.737ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 163.399592ms iteration = 31 status = 0
43582024-11-14T06:34:29.738ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43592024-11-14T06:34:29.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43602024-11-14T06:34:29.739ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
43612024-11-14T06:34:29.739ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43622024-11-14T06:34:29.739ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
43632024-11-14T06:34:29.739ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 30e11b92-f705-4c8e-bce7-d646f8ce00cf dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
43642024-11-14T06:34:29.739ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43652024-11-14T06:34:29.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43662024-11-14T06:34:29.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43672024-11-14T06:34:29.740ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43682024-11-14T06:34:29.741ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43692024-11-14T06:34:29.742ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = c6d59938-b455-4e7b-9d17-0d6427a65b9c dns_zone_name = oxide.test found_so_far = 1 version = 2
43702024-11-14T06:34:29.742ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
43712024-11-14T06:34:29.742ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-14 06:19:31.616543 UTC dns_group = external generation = 2
43722024-11-14T06:34:29.742ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 167.785754ms iteration = 16 status = {"generation":2}
43732024-11-14T06:34:29.745ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
43742024-11-14T06:34:29.746ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43752024-11-14T06:34:29.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43762024-11-14T06:34:29.746ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
43772024-11-14T06:34:29.746ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43782024-11-14T06:34:29.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43792024-11-14T06:34:29.749ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 30e11b92-f705-4c8e-bce7-d646f8ce00cf dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
43802024-11-14T06:34:29.749ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
43812024-11-14T06:34:29.749ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-14 06:19:30.340423 UTC dns_group = internal generation = 1
43822024-11-14T06:34:29.749ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 174.62932ms iteration = 16 status = {"generation":1}
43832024-11-14T06:34:29.749ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43842024-11-14T06:34:29.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43852024-11-14T06:34:29.751ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43862024-11-14T06:34:29.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43872024-11-14T06:34:29.753ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43882024-11-14T06:34:29.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43892024-11-14T06:34:29.758ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T06:19:27.309503Z, time_modified: 2024-11-14T06:19:27.309503Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, db_silo: Silo { identity: SiloIdentity { id: 95153e51-68aa-4bd4-8e65-b8164172811d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T06:19:31.569300Z, time_modified: 2024-11-14T06:19:31.569300Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, db_silo: Silo { identity: SiloIdentity { id: 95153e51-68aa-4bd4-8e65-b8164172811d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T06:19:31.569300Z, time_modified: 2024-11-14T06:19:31.569300Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89" }] }) }
43902024-11-14T06:34:29.758ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 184.207959ms iteration = 16 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"95153e51-68aa-4bd4-8e65-b8164172811d","tls_certs":["3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89"]}},"default_endpoint":{"silo_id":"95153e51-68aa-4bd4-8e65-b8164172811d","tls_certs":["3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
43912024-11-14T06:34:29.763ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43922024-11-14T06:34:29.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43932024-11-14T06:34:29.765ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43942024-11-14T06:34:29.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43952024-11-14T06:34:29.767ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43962024-11-14T06:34:29.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43972024-11-14T06:34:29.769ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43982024-11-14T06:34:29.771ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
43992024-11-14T06:34:29.773ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
44002024-11-14T06:34:29.774ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44012024-11-14T06:34:29.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44022024-11-14T06:34:29.779ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44032024-11-14T06:34:29.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44042024-11-14T06:34:29.782ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44052024-11-14T06:34:29.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44062024-11-14T06:34:29.787ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44072024-11-14T06:34:29.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44082024-11-14T06:34:29.793ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44092024-11-14T06:34:29.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44102024-11-14T06:34:29.795ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 221.193687ms iteration = 34 status = {"physical_disks_added":0}
44112024-11-14T06:34:29.796ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44122024-11-14T06:34:29.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44132024-11-14T06:34:29.798ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
44142024-11-14T06:34:29.798ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 223.847157ms iteration = 16 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
44152024-11-14T06:34:29.798ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44162024-11-14T06:34:29.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44172024-11-14T06:34:29.800ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44182024-11-14T06:34:29.805ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
44192024-11-14T06:34:29.805ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44202024-11-14T06:34:29.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44212024-11-14T06:34:29.817ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44222024-11-14T06:34:29.817ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44232024-11-14T06:34:29.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44242024-11-14T06:34:29.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44252024-11-14T06:34:29.820ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44262024-11-14T06:34:29.820ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44272024-11-14T06:34:29.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44282024-11-14T06:34:29.823ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44292024-11-14T06:34:29.823ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
44302024-11-14T06:34:29.823ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44312024-11-14T06:34:29.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44322024-11-14T06:34:29.826ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44332024-11-14T06:34:29.826ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 zone_address = fd00:1122:3344:101::2
44342024-11-14T06:34:29.826ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44352024-11-14T06:34:29.826ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d0e3e76e-1860-4270-9365-5f37e22f2680", "content-length": "26", "date": "Thu, 14 Nov 2024 06:34:29 GMT"} })
44362024-11-14T06:34:29.826ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44372024-11-14T06:34:29.828ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
44382024-11-14T06:34:29.828ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44392024-11-14T06:34:29.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44402024-11-14T06:34:29.829ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
44412024-11-14T06:34:29.829ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
44422024-11-14T06:34:29.829ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44432024-11-14T06:34:29.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44442024-11-14T06:34:29.834ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44452024-11-14T06:34:29.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44462024-11-14T06:34:29.836ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44472024-11-14T06:34:29.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44482024-11-14T06:34:29.838ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44492024-11-14T06:34:29.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44502024-11-14T06:34:29.842ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44512024-11-14T06:34:29.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44522024-11-14T06:34:29.845ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44532024-11-14T06:34:29.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44542024-11-14T06:34:29.891ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
44552024-11-14T06:34:29.892ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44562024-11-14T06:34:29.892ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4819fba4-7a4e-4cfd-bcca-54a99aba55ca", "content-length": "26", "date": "Thu, 14 Nov 2024 06:34:29 GMT"} })
44572024-11-14T06:34:29.892ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44582024-11-14T06:34:29.894ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
44592024-11-14T06:34:29.903ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
44602024-11-14T06:34:29.903ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44612024-11-14T06:34:29.903ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "195471c2-298a-4454-9102-5e71dbaa6e2e", "content-length": "26", "date": "Thu, 14 Nov 2024 06:34:29 GMT"} })
44622024-11-14T06:34:29.903ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44632024-11-14T06:34:29.905ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
44642024-11-14T06:34:29.917ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
44652024-11-14T06:34:29.997ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
44662024-11-14T06:34:29.997ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
44672024-11-14T06:34:30.056ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
44682024-11-14T06:34:30.057ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "cfd8d279-0a20-4ed0-84f3-3cfd9a1203e8", "date": "Thu, 14 Nov 2024 06:34:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
44692024-11-14T06:34:30.057ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
44702024-11-14T06:34:30.059ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "a51150a1-d054-4a06-906d-2218d0e76259", "date": "Thu, 14 Nov 2024 06:34:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
44712024-11-14T06:34:30.059ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
44722024-11-14T06:34:30.060ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
44732024-11-14T06:34:30.060ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 486.22873ms iteration = 18 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
44742024-11-14T06:34:30.103ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
44752024-11-14T06:34:30.105ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44762024-11-14T06:34:30.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44772024-11-14T06:34:30.107ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44782024-11-14T06:34:30.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44792024-11-14T06:34:30.109ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1ceacbbf-031f-4de5-a472-a77473cfe53b", "content-length": "372", "date": "Thu, 14 Nov 2024 06:34:30 GMT"} })
44802024-11-14T06:34:30.109ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44812024-11-14T06:34:30.109ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "03104757-02eb-4dba-ba16-0b19444079d2", "content-length": "691", "date": "Thu, 14 Nov 2024 06:34:29 GMT"} })
44822024-11-14T06:34:30.109ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
44832024-11-14T06:34:30.109ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
44842024-11-14T06:34:30.109ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
44852024-11-14T06:34:30.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44862024-11-14T06:34:30.110ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44872024-11-14T06:34:30.111ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 537.293281ms iteration = 32 status = {}
44882024-11-14T06:34:30.114ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
44892024-11-14T06:34:30.114ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44902024-11-14T06:34:30.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44912024-11-14T06:34:30.117ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44922024-11-14T06:34:30.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44932024-11-14T06:34:30.118ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44942024-11-14T06:34:30.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44952024-11-14T06:34:30.121ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44962024-11-14T06:34:30.125ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
44972024-11-14T06:34:30.125ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44982024-11-14T06:34:30.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44992024-11-14T06:34:30.133ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 44b33ba4-d228-461a-936e-500ecd8234e8, kind: Service { id: 6e81a29a-9566-4f30-8c2b-046fbbd99dfa }, name: Name("nexus-6e81a29a-9566-4f30-8c2b-046fbbd99dfa"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 136])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 916a8c66-d641-42bc-8af2-c47fc40ac221, kind: Service { id: 80190dc3-d884-49a0-b9a3-38d31e8c655a }, name: Name("nexus-80190dc3-d884-49a0-b9a3-38d31e8c655a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9a40ff81-4129-4ebe-8b5e-aa7b0c0227b9, kind: Service { id: b8f86511-dd51-4fcd-bfdc-8e92264988b6 }, name: Name("nexus-b8f86511-dd51-4fcd-bfdc-8e92264988b6"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 88])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 015932fe-ddf2-4239-b1fd-e7424a4040be, kind: Service { id: f40de7f6-4bc1-4578-baeb-b08e777b4bed }, name: Name("external-dns-f40de7f6-4bc1-4578-baeb-b08e777b4bed"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 243])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 0e6ae03a-a5e3-484d-8e1e-e705408292b1, kind: Service { id: 720ac48b-8596-4763-a661-482d124c0a16 }, name: Name("external-dns-720ac48b-8596-4763-a661-482d124c0a16"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 194])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
45002024-11-14T06:34:30.133ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
45012024-11-14T06:34:30.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
45022024-11-14T06:34:30.133ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
45032024-11-14T06:34:30.134ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "5b268334-b7ec-4264-9d92-8b9424c656f2", "content-length": "2", "date": "Thu, 14 Nov 2024 06:34:30 GMT"} })
45042024-11-14T06:34:30.135ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45052024-11-14T06:34:30.136ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
45062024-11-14T06:34:30.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
45072024-11-14T06:34:30.137ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
45082024-11-14T06:34:30.137ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
45092024-11-14T06:34:30.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
45102024-11-14T06:34:30.138ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 564.1412ms iteration = 31 status = null
45112024-11-14T06:34:30.139ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
45122024-11-14T06:34:30.139ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 015932fe-ddf2-4239-b1fd-e7424a4040be, kind: Service { id: f40de7f6-4bc1-4578-baeb-b08e777b4bed }, name: Name("external-dns-f40de7f6-4bc1-4578-baeb-b08e777b4bed"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 243])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 0e6ae03a-a5e3-484d-8e1e-e705408292b1, kind: Service { id: 720ac48b-8596-4763-a661-482d124c0a16 }, name: Name("external-dns-720ac48b-8596-4763-a661-482d124c0a16"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 194])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 44b33ba4-d228-461a-936e-500ecd8234e8, kind: Service { id: 6e81a29a-9566-4f30-8c2b-046fbbd99dfa }, name: Name("nexus-6e81a29a-9566-4f30-8c2b-046fbbd99dfa"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 136])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 916a8c66-d641-42bc-8af2-c47fc40ac221, kind: Service { id: 80190dc3-d884-49a0-b9a3-38d31e8c655a }, name: Name("nexus-80190dc3-d884-49a0-b9a3-38d31e8c655a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9a40ff81-4129-4ebe-8b5e-aa7b0c0227b9, kind: Service { id: b8f86511-dd51-4fcd-bfdc-8e92264988b6 }, name: Name("nexus-b8f86511-dd51-4fcd-bfdc-8e92264988b6"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 88])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
45132024-11-14T06:34:30.139ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
45142024-11-14T06:34:30.157ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
45152024-11-14T06:34:30.157ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
45162024-11-14T06:34:30.157ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "2f529fac-1cb9-49ae-a4ad-3a743e9fcfbe", "date": "Thu, 14 Nov 2024 06:34:30 GMT"} })
45172024-11-14T06:34:30.157ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45182024-11-14T06:34:30.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45192024-11-14T06:34:30.159ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45202024-11-14T06:34:30.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45212024-11-14T06:34:30.162ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45222024-11-14T06:34:30.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45232024-11-14T06:34:30.171ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
45242024-11-14T06:34:30.171ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
45252024-11-14T06:34:30.174ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 599.56056ms iteration = 31 status = {}
45262024-11-14T06:34:30.174ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
45272024-11-14T06:34:30.174ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "e6d3ba43-6247-458d-b5c6-b7fab55411c5", "date": "Thu, 14 Nov 2024 06:34:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
45282024-11-14T06:34:30.174ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
45292024-11-14T06:34:30.176ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "d0436e13-cf28-4513-9ce8-a727795f060d", "date": "Thu, 14 Nov 2024 06:34:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
45302024-11-14T06:34:30.176ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
45312024-11-14T06:34:30.178ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "b51621db-d5d1-4b1d-a2fc-dbed33d14023", "date": "Thu, 14 Nov 2024 06:34:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
45322024-11-14T06:34:30.178ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
45332024-11-14T06:34:30.178ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "711ba3bc-3187-4962-86a5-9f92c3789765", "date": "Thu, 14 Nov 2024 06:34:30 GMT"} })
45342024-11-14T06:34:30.180ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
45352024-11-14T06:34:30.180ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 605.847087ms iteration = 18 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
45362024-11-14T06:34:30.180ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 605.375178ms iteration = 32 status = {}
45372024-11-14T06:34:30.194ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 27a56cb4-44ff-4d5b-931e-1c2c0642844d, time_created: 2024-11-14T06:19:28.463914Z, time_modified: 2024-11-14T06:19:28.463914Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: f391bffc-9f2b-4c87-85cd-2718afa7cb93, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::1:0, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
45382024-11-14T06:34:30.195ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
45392024-11-14T06:34:30.195ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
45402024-11-14T06:34:30.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
45412024-11-14T06:34:30.196ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
45422024-11-14T06:34:30.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
45432024-11-14T06:34:30.198ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45442024-11-14T06:34:30.201ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 27a56cb4-44ff-4d5b-931e-1c2c0642844d, lookup_type: ById(27a56cb4-44ff-4d5b-931e-1c2c0642844d) } result = Ok(())
45452024-11-14T06:34:30.207ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45462024-11-14T06:34:30.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45472024-11-14T06:34:30.210ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: cecfafa4-4697-4aa6-949f-23c34aa9d5bd, rack_id: f391bffc-9f2b-4c87-85cd-2718afa7cb93, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(58c91208-be0a-4936-a7c2-2ae07694e16d) } rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
45482024-11-14T06:34:30.210ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45492024-11-14T06:34:30.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45502024-11-14T06:34:30.220ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
45512024-11-14T06:34:30.221ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "c57f1c72-9097-4a99-9bc9-7b5a7ddc4af6", "content-length": "134", "date": "Thu, 14 Nov 2024 06:34:30 GMT"} })
45522024-11-14T06:34:30.221ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
45532024-11-14T06:34:30.221ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 58c91208-be0a-4936-a7c2-2ae07694e16d
45542024-11-14T06:34:30.221ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
45552024-11-14T06:34:30.221ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
45562024-11-14T06:34:30.221ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
45572024-11-14T06:34:30.221ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
45582024-11-14T06:34:30.221ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
45592024-11-14T06:34:30.221ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
45602024-11-14T06:34:30.221ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
45612024-11-14T06:34:30.221ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
45622024-11-14T06:34:30.221ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
45632024-11-14T06:34:30.221ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45642024-11-14T06:34:30.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45652024-11-14T06:34:30.223ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
45662024-11-14T06:34:30.223ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ce3a5c7-641c-4144-bc73-51f731e9eea2", "content-length": "2", "date": "Thu, 14 Nov 2024 06:34:30 GMT"} })
45672024-11-14T06:34:30.223ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
45682024-11-14T06:34:30.223ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "4f4e7a8f-4b3b-476d-ac72-7ddb837e00e5", "content-length": "52", "date": "Thu, 14 Nov 2024 06:34:30 GMT"} })
45692024-11-14T06:34:30.223ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
45702024-11-14T06:34:30.223ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
45712024-11-14T06:34:30.234ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
45722024-11-14T06:34:30.235ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "ab6e69ca-5674-4343-8fce-356675d800ea", "date": "Thu, 14 Nov 2024 06:34:30 GMT"} })
45732024-11-14T06:34:30.236ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
45742024-11-14T06:34:30.236ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 661.472973ms
45752024-11-14T06:34:30.236ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 661.480913ms iteration = 4 status = {}
45762024-11-14T06:34:30.340ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "501605e1-9343-4e14-9c2b-c60662a8797c", "date": "Thu, 14 Nov 2024 06:34:30 GMT"} })
45772024-11-14T06:34:30.340ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch = Switch0
45782024-11-14T06:34:30.340ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
45792024-11-14T06:34:30.340ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f6df3b0e-fedd-4689-b7fb-fe0f2633058c", "content-length": "682", "date": "Thu, 14 Nov 2024 06:34:30 GMT"} })
45802024-11-14T06:34:30.340ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45812024-11-14T06:34:30.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45822024-11-14T06:34:30.344ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45832024-11-14T06:34:30.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45842024-11-14T06:34:30.347ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45852024-11-14T06:34:30.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45862024-11-14T06:34:30.349ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45872024-11-14T06:34:30.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45882024-11-14T06:34:30.357ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 782.7599ms iteration = 31 status = {}
45892024-11-14T06:34:30.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 3edadd09-ac0a-4160-9904-b91ac401ee68 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
45902024-11-14T06:34:30.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 3edadd09-ac0a-4160-9904-b91ac401ee68 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
45912024-11-14T06:34:30.753ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1926 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 3edadd09-ac0a-4160-9904-b91ac401ee68 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
45922024-11-14T06:34:31.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = a3b50fc5-c678-4440-a532-4063c2ebb637 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
45932024-11-14T06:34:31.774ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = a3b50fc5-c678-4440-a532-4063c2ebb637 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
45942024-11-14T06:34:31.776ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2265 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = a3b50fc5-c678-4440-a532-4063c2ebb637 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
45952024-11-14T06:34:32.158ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36021 req_id = 1ddea1ff-3dcb-4ccf-9bd4-fb7dcaf12b64 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/12?limit=100
45962024-11-14T06:34:32.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36021 req_id = 1ddea1ff-3dcb-4ccf-9bd4-fb7dcaf12b64 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/12?limit=100
45972024-11-14T06:34:32.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3142 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36021 req_id = 1ddea1ff-3dcb-4ccf-9bd4-fb7dcaf12b64 response_code = 200 uri = /nat/ipv4/changeset/12?limit=100
45982024-11-14T06:34:32.797ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = a28b3cae-2a12-49e5-9a29-ebae1274f682 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
45992024-11-14T06:34:32.797ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = a28b3cae-2a12-49e5-9a29-ebae1274f682 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
46002024-11-14T06:34:32.799ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2341 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = a28b3cae-2a12-49e5-9a29-ebae1274f682 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
46012024-11-14T06:34:33.820ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f188db12-4db7-4e04-9063-043143c4edfe roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
46022024-11-14T06:34:33.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f188db12-4db7-4e04-9063-043143c4edfe resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
46032024-11-14T06:34:33.823ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2545 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f188db12-4db7-4e04-9063-043143c4edfe response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
46042024-11-14T06:34:34.844ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = abe15d8b-20bb-4d24-b205-3d8182900d75 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
46052024-11-14T06:34:34.844ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = abe15d8b-20bb-4d24-b205-3d8182900d75 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
46062024-11-14T06:34:34.846ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2192 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = abe15d8b-20bb-4d24-b205-3d8182900d75 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
46072024-11-14T06:34:35.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 43d1a089-f0f6-4e4e-b38b-3e5bcd8d7216 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
46082024-11-14T06:34:35.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 43d1a089-f0f6-4e4e-b38b-3e5bcd8d7216 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
46092024-11-14T06:34:35.871ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2919 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 43d1a089-f0f6-4e4e-b38b-3e5bcd8d7216 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
46102024-11-14T06:34:36.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 2e9e8ee6-9503-4512-a353-1fd59b5131e6 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
46112024-11-14T06:34:36.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 2e9e8ee6-9503-4512-a353-1fd59b5131e6 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
46122024-11-14T06:34:36.893ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2380 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 2e9e8ee6-9503-4512-a353-1fd59b5131e6 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
46132024-11-14T06:34:37.606ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 623 local_addr = [fd00:1122:3344:101::c]:60882 method = GET remote_addr = [fd00:1122:3344:101::d]:64488 req_id = 5083c670-95c9-4da0-ab59-ae8a32e4eec3 response_code = 200 uri = /80190dc3-d884-49a0-b9a3-38d31e8c655a
46142024-11-14T06:34:37.914ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = c189239e-706a-4ba3-818a-1102bf98da77 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
46152024-11-14T06:34:37.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = c189239e-706a-4ba3-818a-1102bf98da77 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
46162024-11-14T06:34:37.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2171 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = c189239e-706a-4ba3-818a-1102bf98da77 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
46172024-11-14T06:34:38.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 8fb98fb7-46da-4172-8648-91f1b2ef811b roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
46182024-11-14T06:34:38.939ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 8fb98fb7-46da-4172-8648-91f1b2ef811b resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
46192024-11-14T06:34:38.941ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2394 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 8fb98fb7-46da-4172-8648-91f1b2ef811b response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
46202024-11-14T06:34:39.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 92 reason = Timeout
46212024-11-14T06:34:39.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 92 reason = Timeout
46222024-11-14T06:34:39.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46232024-11-14T06:34:39.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46242024-11-14T06:34:39.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46252024-11-14T06:34:39.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46262024-11-14T06:34:39.576ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46272024-11-14T06:34:39.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46282024-11-14T06:34:39.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46292024-11-14T06:34:39.578ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.599757ms iteration = 92 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
46302024-11-14T06:34:39.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
46312024-11-14T06:34:39.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46322024-11-14T06:34:39.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46332024-11-14T06:34:39.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46342024-11-14T06:34:39.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46352024-11-14T06:34:39.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46362024-11-14T06:34:39.586ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
46372024-11-14T06:34:39.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46382024-11-14T06:34:39.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46392024-11-14T06:34:39.595ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
46402024-11-14T06:34:39.595ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.754786ms iteration = 92 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
46412024-11-14T06:34:39.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = fc537d8c-d1fd-4ac6-99d9-e2b27bcfd6da roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
46422024-11-14T06:34:39.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = fc537d8c-d1fd-4ac6-99d9-e2b27bcfd6da resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
46432024-11-14T06:34:39.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2622 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = fc537d8c-d1fd-4ac6-99d9-e2b27bcfd6da response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
46442024-11-14T06:34:40.986ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 2d93d8af-365f-49a4-9c25-0ea240f7f349 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
46452024-11-14T06:34:40.986ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 2d93d8af-365f-49a4-9c25-0ea240f7f349 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
46462024-11-14T06:34:40.988ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2287 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 2d93d8af-365f-49a4-9c25-0ea240f7f349 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
46472024-11-14T06:34:42.011ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 173565c3-6f8c-4167-9cec-32f4c2ff7262 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
46482024-11-14T06:34:42.011ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 173565c3-6f8c-4167-9cec-32f4c2ff7262 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
46492024-11-14T06:34:42.013ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2463 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 173565c3-6f8c-4167-9cec-32f4c2ff7262 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
46502024-11-14T06:34:43.036ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 635ea0e7-19c3-4424-9baa-ba325b8b4da3 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
46512024-11-14T06:34:43.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 635ea0e7-19c3-4424-9baa-ba325b8b4da3 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
46522024-11-14T06:34:43.038ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2748 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 635ea0e7-19c3-4424-9baa-ba325b8b4da3 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
46532024-11-14T06:34:44.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 531af1ab-ef27-4593-b854-aee0e55e29f0 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
46542024-11-14T06:34:44.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 531af1ab-ef27-4593-b854-aee0e55e29f0 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
46552024-11-14T06:34:44.062ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2541 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 531af1ab-ef27-4593-b854-aee0e55e29f0 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
46562024-11-14T06:34:45.083ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 98b5983a-f530-411a-a2c1-d3325231489d roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
46572024-11-14T06:34:45.084ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 98b5983a-f530-411a-a2c1-d3325231489d resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
46582024-11-14T06:34:45.086ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2479 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 98b5983a-f530-411a-a2c1-d3325231489d response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
46592024-11-14T06:34:46.106ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 7c72d926-1c10-4505-a6bf-aa5bdd541779 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
46602024-11-14T06:34:46.106ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 7c72d926-1c10-4505-a6bf-aa5bdd541779 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
46612024-11-14T06:34:46.108ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2415 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 7c72d926-1c10-4505-a6bf-aa5bdd541779 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
46622024-11-14T06:34:47.130ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f4c8bf1c-8777-41b9-83dc-eed38d6b9186 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
46632024-11-14T06:34:47.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f4c8bf1c-8777-41b9-83dc-eed38d6b9186 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
46642024-11-14T06:34:47.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2814 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f4c8bf1c-8777-41b9-83dc-eed38d6b9186 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
46652024-11-14T06:34:48.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = fb817f85-e199-4dcf-b6b8-9d1591d63d50 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
46662024-11-14T06:34:48.155ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = fb817f85-e199-4dcf-b6b8-9d1591d63d50 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
46672024-11-14T06:34:48.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2601 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = fb817f85-e199-4dcf-b6b8-9d1591d63d50 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
46682024-11-14T06:34:49.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = b3a40cdf-5e6e-49f0-a228-efe83d067584 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
46692024-11-14T06:34:49.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = b3a40cdf-5e6e-49f0-a228-efe83d067584 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
46702024-11-14T06:34:49.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2414 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = b3a40cdf-5e6e-49f0-a228-efe83d067584 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
46712024-11-14T06:34:49.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 93 reason = Timeout
46722024-11-14T06:34:49.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46732024-11-14T06:34:49.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 93 reason = Timeout
46742024-11-14T06:34:49.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46752024-11-14T06:34:49.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46762024-11-14T06:34:49.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46772024-11-14T06:34:49.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46782024-11-14T06:34:49.576ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46792024-11-14T06:34:49.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46802024-11-14T06:34:49.578ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
46812024-11-14T06:34:49.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46822024-11-14T06:34:49.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46832024-11-14T06:34:49.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46842024-11-14T06:34:49.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46852024-11-14T06:34:49.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46862024-11-14T06:34:49.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
46872024-11-14T06:34:49.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46882024-11-14T06:34:49.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46892024-11-14T06:34:49.596ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
46902024-11-14T06:34:49.596ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.693113ms iteration = 93 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
46912024-11-14T06:34:49.604ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.661331ms iteration = 93 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
46922024-11-14T06:34:50.204ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = a5cb0931-df3f-4088-b054-b0e90a6215ba roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
46932024-11-14T06:34:50.204ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = a5cb0931-df3f-4088-b054-b0e90a6215ba resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
46942024-11-14T06:34:50.206ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2527 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = a5cb0931-df3f-4088-b054-b0e90a6215ba response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
46952024-11-14T06:34:51.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 85ae887a-4d93-4c3e-a763-befd90c438b6 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
46962024-11-14T06:34:51.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 85ae887a-4d93-4c3e-a763-befd90c438b6 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
46972024-11-14T06:34:51.232ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4485 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 85ae887a-4d93-4c3e-a763-befd90c438b6 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
46982024-11-14T06:34:52.256ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 9d343f77-b99d-4326-bfe9-462411dc366a roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
46992024-11-14T06:34:52.257ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 9d343f77-b99d-4326-bfe9-462411dc366a resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
47002024-11-14T06:34:52.259ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2623 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 9d343f77-b99d-4326-bfe9-462411dc366a response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
47012024-11-14T06:34:52.605ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 581 local_addr = [fd00:1122:3344:101::c]:60882 method = GET remote_addr = [fd00:1122:3344:101::d]:64488 req_id = 66f59249-bb4a-4cf4-8ebb-f5ed33410a3f response_code = 200 uri = /80190dc3-d884-49a0-b9a3-38d31e8c655a
47022024-11-14T06:34:53.282ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = aa1df753-0237-4d81-9eee-d9e69a079736 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
47032024-11-14T06:34:53.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = aa1df753-0237-4d81-9eee-d9e69a079736 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
47042024-11-14T06:34:53.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2370 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = aa1df753-0237-4d81-9eee-d9e69a079736 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
47052024-11-14T06:34:54.305ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = fad8822d-8275-4174-8205-646250f5de4c roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
47062024-11-14T06:34:54.306ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = fad8822d-8275-4174-8205-646250f5de4c resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
47072024-11-14T06:34:54.308ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2567 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = fad8822d-8275-4174-8205-646250f5de4c response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
47082024-11-14T06:34:55.328ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 2252953d-77ff-432a-bdcc-4ede70f4038d roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
47092024-11-14T06:34:55.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 2252953d-77ff-432a-bdcc-4ede70f4038d resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
47102024-11-14T06:34:55.330ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2593 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 2252953d-77ff-432a-bdcc-4ede70f4038d response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
47112024-11-14T06:34:56.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f72f1a4c-2d7d-44f3-9616-35dc30dc2242 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
47122024-11-14T06:34:56.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f72f1a4c-2d7d-44f3-9616-35dc30dc2242 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
47132024-11-14T06:34:56.355ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2483 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f72f1a4c-2d7d-44f3-9616-35dc30dc2242 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
47142024-11-14T06:34:57.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 855e952d-b93e-44cf-a7fd-b5ea71a3a2b5 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
47152024-11-14T06:34:57.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 855e952d-b93e-44cf-a7fd-b5ea71a3a2b5 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
47162024-11-14T06:34:57.378ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2204 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 855e952d-b93e-44cf-a7fd-b5ea71a3a2b5 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
47172024-11-14T06:34:57.598ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:33605
47182024-11-14T06:34:57.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33605 req_id = 37c45185-9306-439c-bb62-050a7e7441fc roles = RoleSet { roles: {} } uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
47192024-11-14T06:34:57.599ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33605 req_id = 37c45185-9306-439c-bb62-050a7e7441fc resource = Database result = Ok(()) uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
47202024-11-14T06:34:57.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3545 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33605 req_id = 37c45185-9306-439c-bb62-050a7e7441fc response_code = 200 uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
47212024-11-14T06:34:57.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33605 req_id = c926c071-8b7f-45fc-a060-b3cc5560e8de roles = RoleSet { roles: {} } uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
47222024-11-14T06:34:57.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33605 req_id = c926c071-8b7f-45fc-a060-b3cc5560e8de resource = Database result = Ok(()) uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
47232024-11-14T06:34:57.604ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2233 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33605 req_id = c926c071-8b7f-45fc-a060-b3cc5560e8de response_code = 200 uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
47242024-11-14T06:34:58.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 6c961dcb-7459-4f8b-a910-30e08c10c05f roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
47252024-11-14T06:34:58.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 6c961dcb-7459-4f8b-a910-30e08c10c05f resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
47262024-11-14T06:34:58.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2632 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 6c961dcb-7459-4f8b-a910-30e08c10c05f response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
47272024-11-14T06:34:59.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = a7107de6-a4d0-485c-b0f1-0487b32fc99d roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
47282024-11-14T06:34:59.425ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = a7107de6-a4d0-485c-b0f1-0487b32fc99d resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
47292024-11-14T06:34:59.427ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3084 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = a7107de6-a4d0-485c-b0f1-0487b32fc99d response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
47302024-11-14T06:34:59.574ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 32 reason = Timeout
47312024-11-14T06:34:59.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 32 reason = Timeout
47322024-11-14T06:34:59.574ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47332024-11-14T06:34:59.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
47342024-11-14T06:34:59.574ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 32 reason = Timeout
47352024-11-14T06:34:59.574ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 35 reason = Timeout
47362024-11-14T06:34:59.574ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 32 reason = Timeout
47372024-11-14T06:34:59.574ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47382024-11-14T06:34:59.574ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 32 reason = Timeout
47392024-11-14T06:34:59.574ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
47402024-11-14T06:34:59.574ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
47412024-11-14T06:34:59.574ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
47422024-11-14T06:34:59.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 94 reason = Timeout
47432024-11-14T06:34:59.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47442024-11-14T06:34:59.574ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 32 reason = Timeout
47452024-11-14T06:34:59.574ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 32 reason = Timeout
47462024-11-14T06:34:59.574ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47472024-11-14T06:34:59.574ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
47482024-11-14T06:34:59.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 94 reason = Timeout
47492024-11-14T06:34:59.574ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 33 reason = Timeout
47502024-11-14T06:34:59.574ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 32 reason = Timeout
47512024-11-14T06:34:59.574ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47522024-11-14T06:34:59.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47532024-11-14T06:34:59.574ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
47542024-11-14T06:34:59.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
47552024-11-14T06:34:59.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47562024-11-14T06:34:59.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47572024-11-14T06:34:59.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
47582024-11-14T06:34:59.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47592024-11-14T06:34:59.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
47602024-11-14T06:34:59.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47612024-11-14T06:34:59.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
47622024-11-14T06:34:59.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
47632024-11-14T06:34:59.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47642024-11-14T06:34:59.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47652024-11-14T06:34:59.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 32 reason = Timeout
47662024-11-14T06:34:59.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 32 reason = Timeout
47672024-11-14T06:34:59.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
47682024-11-14T06:34:59.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
47692024-11-14T06:34:59.575ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 33 reason = Timeout
47702024-11-14T06:34:59.575ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
47712024-11-14T06:34:59.575ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47722024-11-14T06:34:59.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 32 reason = Timeout
47732024-11-14T06:34:59.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
47742024-11-14T06:34:59.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 32 reason = Timeout
47752024-11-14T06:34:59.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
47762024-11-14T06:34:59.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
47772024-11-14T06:34:59.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
47782024-11-14T06:34:59.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
47792024-11-14T06:34:59.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47802024-11-14T06:34:59.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
47812024-11-14T06:34:59.577ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47822024-11-14T06:34:59.577ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.031457ms iteration = 32 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
47832024-11-14T06:34:59.578ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47842024-11-14T06:34:59.579ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1956, tv_nsec: 137387388 } })
47852024-11-14T06:34:59.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
47862024-11-14T06:34:59.579ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47872024-11-14T06:34:59.579ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
47882024-11-14T06:34:59.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47892024-11-14T06:34:59.580ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
47902024-11-14T06:34:59.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
47912024-11-14T06:34:59.580ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47922024-11-14T06:34:59.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
47932024-11-14T06:34:59.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47942024-11-14T06:34:59.580ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
47952024-11-14T06:34:59.580ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
47962024-11-14T06:34:59.580ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
47972024-11-14T06:34:59.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
47982024-11-14T06:34:59.581ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47992024-11-14T06:34:59.583ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48002024-11-14T06:34:59.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48012024-11-14T06:34:59.583ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1956, tv_nsec: 141654278 } })
48022024-11-14T06:34:59.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
48032024-11-14T06:34:59.583ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48042024-11-14T06:34:59.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48052024-11-14T06:34:59.584ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
48062024-11-14T06:34:59.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
48072024-11-14T06:34:59.585ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
48082024-11-14T06:34:59.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
48092024-11-14T06:34:59.587ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 11.328961ms iteration = 32 status = {"errors":[],"records_set_to_done":[]}
48102024-11-14T06:34:59.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
48112024-11-14T06:34:59.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48122024-11-14T06:34:59.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48132024-11-14T06:34:59.587ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
48142024-11-14T06:34:59.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
48152024-11-14T06:34:59.588ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48162024-11-14T06:34:59.589ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48172024-11-14T06:34:59.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48182024-11-14T06:34:59.590ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 15.659962ms iteration = 32 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
48192024-11-14T06:34:59.590ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
48202024-11-14T06:34:59.590ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48212024-11-14T06:34:59.590ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1956, tv_nsec: 148597277 } })
48222024-11-14T06:34:59.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48232024-11-14T06:34:59.591ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
48242024-11-14T06:34:59.593ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48252024-11-14T06:34:59.593ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48262024-11-14T06:34:59.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48272024-11-14T06:34:59.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48282024-11-14T06:34:59.595ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48292024-11-14T06:34:59.596ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48302024-11-14T06:34:59.599ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
48312024-11-14T06:34:59.599ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 24.267452ms iteration = 32 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
48322024-11-14T06:34:59.599ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
48332024-11-14T06:34:59.599ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48342024-11-14T06:34:59.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48352024-11-14T06:34:59.599ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
48362024-11-14T06:34:59.599ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48372024-11-14T06:34:59.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48382024-11-14T06:34:59.600ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48392024-11-14T06:34:59.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48402024-11-14T06:34:59.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48412024-11-14T06:34:59.604ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48422024-11-14T06:34:59.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48432024-11-14T06:34:59.604ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
48442024-11-14T06:34:59.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48452024-11-14T06:34:59.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48462024-11-14T06:34:59.606ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48472024-11-14T06:34:59.607ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
48482024-11-14T06:34:59.607ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48492024-11-14T06:34:59.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48502024-11-14T06:34:59.619ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48512024-11-14T06:34:59.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48522024-11-14T06:34:59.622ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48532024-11-14T06:34:59.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48542024-11-14T06:34:59.623ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
48552024-11-14T06:34:59.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
48562024-11-14T06:34:59.624ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48572024-11-14T06:34:59.625ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
48582024-11-14T06:34:59.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
48592024-11-14T06:34:59.627ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
48602024-11-14T06:34:59.627ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 52.377495ms iteration = 94 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
48612024-11-14T06:34:59.628ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 27a56cb4-44ff-4d5b-931e-1c2c0642844d, lookup_type: ById(27a56cb4-44ff-4d5b-931e-1c2c0642844d) } result = Ok(())
48622024-11-14T06:34:59.628ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48632024-11-14T06:34:59.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48642024-11-14T06:34:59.630ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48652024-11-14T06:34:59.630ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 56.075843ms iteration = 32 status = 0
48662024-11-14T06:34:59.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48672024-11-14T06:34:59.632ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.49315ms iteration = 94 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
48682024-11-14T06:34:59.632ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 56.354189ms iteration = 32 status = {"errors":[],"garbage_collect_requested":[]}
48692024-11-14T06:34:59.636ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 60.148409ms iteration = 32 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
48702024-11-14T06:34:59.642ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
48712024-11-14T06:34:59.642ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
48722024-11-14T06:34:59.642ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
48732024-11-14T06:34:59.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
48742024-11-14T06:34:59.657ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 82.071098ms iteration = 32 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
48752024-11-14T06:34:59.662ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48762024-11-14T06:34:59.663ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
48772024-11-14T06:34:59.664ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48782024-11-14T06:34:59.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48792024-11-14T06:34:59.671ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
48802024-11-14T06:34:59.671ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
48812024-11-14T06:34:59.672ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d7f68029-386e-472b-9440-609f46b4e69e", "content-length": "26", "date": "Thu, 14 Nov 2024 06:34:59 GMT"} })
48822024-11-14T06:34:59.672ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
48832024-11-14T06:34:59.673ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
48842024-11-14T06:34:59.682ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
48852024-11-14T06:34:59.682ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
48862024-11-14T06:34:59.682ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 107.369509ms iteration = 32 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
48872024-11-14T06:34:59.705ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 zone_address = fd00:1122:3344:101::2
48882024-11-14T06:34:59.705ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
48892024-11-14T06:34:59.706ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5057952-a4fb-449a-8bd7-08b80ac0285a", "content-length": "26", "date": "Thu, 14 Nov 2024 06:34:59 GMT"} })
48902024-11-14T06:34:59.706ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
48912024-11-14T06:34:59.708ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
48922024-11-14T06:34:59.717ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 142.775347ms iteration = 35 status = {"physical_disks_added":0}
48932024-11-14T06:34:59.728ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
48942024-11-14T06:34:59.728ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
48952024-11-14T06:34:59.729ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "60a35670-9f75-44af-ab34-64f7ede5b31e", "content-length": "26", "date": "Thu, 14 Nov 2024 06:34:59 GMT"} })
48962024-11-14T06:34:59.729ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
48972024-11-14T06:34:59.731ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
48982024-11-14T06:34:59.830ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
48992024-11-14T06:34:59.834ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
49002024-11-14T06:34:59.834ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "49cf3759-e355-458f-b88e-34fb259af468", "content-length": "2", "date": "Thu, 14 Nov 2024 06:34:59 GMT"} })
49012024-11-14T06:34:59.835ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
49022024-11-14T06:34:59.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
49032024-11-14T06:34:59.837ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 262.306312ms iteration = 32 status = null
49042024-11-14T06:34:59.838ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
49052024-11-14T06:34:59.838ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
49062024-11-14T06:34:59.853ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f071cf88-042c-45e9-9b53-2d4b052bfd08", "content-length": "691", "date": "Thu, 14 Nov 2024 06:34:59 GMT"} })
49072024-11-14T06:34:59.853ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
49082024-11-14T06:34:59.853ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
49092024-11-14T06:34:59.853ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
49102024-11-14T06:34:59.853ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "0511df11-0e57-4436-aa13-4d6edd0e7fb4", "content-length": "372", "date": "Thu, 14 Nov 2024 06:34:59 GMT"} })
49112024-11-14T06:34:59.853ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49122024-11-14T06:34:59.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49132024-11-14T06:34:59.855ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 280.722275ms iteration = 33 status = {}
49142024-11-14T06:34:59.868ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
49152024-11-14T06:34:59.868ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
49162024-11-14T06:34:59.868ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "8e71f143-3cb1-42bd-88e8-502f95291d81", "date": "Thu, 14 Nov 2024 06:34:59 GMT"} })
49172024-11-14T06:34:59.868ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49182024-11-14T06:34:59.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49192024-11-14T06:34:59.871ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49202024-11-14T06:34:59.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49212024-11-14T06:34:59.874ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49222024-11-14T06:34:59.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49232024-11-14T06:34:59.879ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
49242024-11-14T06:34:59.879ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
49252024-11-14T06:34:59.879ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a649df5b-6c96-443e-847c-90d62097aa27", "date": "Thu, 14 Nov 2024 06:34:59 GMT"} })
49262024-11-14T06:34:59.881ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 305.208431ms iteration = 33 status = {}
49272024-11-14T06:34:59.915ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 341.087859ms iteration = 32 status = {}
49282024-11-14T06:34:59.972ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49292024-11-14T06:34:59.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49302024-11-14T06:34:59.974ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: cecfafa4-4697-4aa6-949f-23c34aa9d5bd, rack_id: f391bffc-9f2b-4c87-85cd-2718afa7cb93, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(58c91208-be0a-4936-a7c2-2ae07694e16d) } rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
49312024-11-14T06:34:59.974ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49322024-11-14T06:34:59.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49332024-11-14T06:34:59.983ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
49342024-11-14T06:34:59.984ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf2dde14-3c37-4f5b-bf76-ae929b4d6d26", "content-length": "134", "date": "Thu, 14 Nov 2024 06:34:59 GMT"} })
49352024-11-14T06:34:59.984ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
49362024-11-14T06:34:59.984ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 58c91208-be0a-4936-a7c2-2ae07694e16d
49372024-11-14T06:34:59.984ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
49382024-11-14T06:34:59.984ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
49392024-11-14T06:34:59.984ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
49402024-11-14T06:34:59.984ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
49412024-11-14T06:34:59.984ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
49422024-11-14T06:34:59.984ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
49432024-11-14T06:34:59.984ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
49442024-11-14T06:34:59.984ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
49452024-11-14T06:34:59.984ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
49462024-11-14T06:34:59.984ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49472024-11-14T06:34:59.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49482024-11-14T06:34:59.986ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
49492024-11-14T06:34:59.986ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c7e6b4ab-f196-4067-a444-e08085fff5da", "content-length": "2", "date": "Thu, 14 Nov 2024 06:34:59 GMT"} })
49502024-11-14T06:34:59.986ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
49512024-11-14T06:34:59.987ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "22f746f5-ed6d-40a4-94d4-2a1fdd50a534", "content-length": "52", "date": "Thu, 14 Nov 2024 06:34:59 GMT"} })
49522024-11-14T06:34:59.987ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
49532024-11-14T06:34:59.987ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
49542024-11-14T06:35:00.088ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4350ab6d-821d-4305-b6bd-fcada3a577f3", "date": "Thu, 14 Nov 2024 06:34:59 GMT"} })
49552024-11-14T06:35:00.088ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch = Switch0
49562024-11-14T06:35:00.088ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
49572024-11-14T06:35:00.089ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "544cee3c-19a7-4928-a1b5-2e05591da9c4", "content-length": "682", "date": "Thu, 14 Nov 2024 06:34:59 GMT"} })
49582024-11-14T06:35:00.089ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49592024-11-14T06:35:00.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49602024-11-14T06:35:00.092ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49612024-11-14T06:35:00.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49622024-11-14T06:35:00.097ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49632024-11-14T06:35:00.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49642024-11-14T06:35:00.099ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49652024-11-14T06:35:00.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49662024-11-14T06:35:00.105ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 531.30995ms iteration = 32 status = {}
49672024-11-14T06:35:00.457ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 8b00d541-5b92-4530-90d1-a960b275df75 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
49682024-11-14T06:35:00.457ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 8b00d541-5b92-4530-90d1-a960b275df75 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
49692024-11-14T06:35:00.459ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2509 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 8b00d541-5b92-4530-90d1-a960b275df75 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
49702024-11-14T06:35:01.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 9c53b2f4-cd6c-4396-91fb-80e71b65912d roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
49712024-11-14T06:35:01.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 9c53b2f4-cd6c-4396-91fb-80e71b65912d resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
49722024-11-14T06:35:01.484ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2315 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 9c53b2f4-cd6c-4396-91fb-80e71b65912d response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
49732024-11-14T06:35:02.193ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36021 req_id = 53a0fb6a-e849-4965-972c-a200c7638099 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/12?limit=100
49742024-11-14T06:35:02.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36021 req_id = 53a0fb6a-e849-4965-972c-a200c7638099 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/12?limit=100
49752024-11-14T06:35:02.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3773 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36021 req_id = 53a0fb6a-e849-4965-972c-a200c7638099 response_code = 200 uri = /nat/ipv4/changeset/12?limit=100
49762024-11-14T06:35:02.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 07489901-99e4-4cd0-9fb8-7d593fa7acf5 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
49772024-11-14T06:35:02.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 07489901-99e4-4cd0-9fb8-7d593fa7acf5 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
49782024-11-14T06:35:02.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1816 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 07489901-99e4-4cd0-9fb8-7d593fa7acf5 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
49792024-11-14T06:35:03.529ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = e964e10e-aace-4d31-a9b7-1541b9b60db4 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
49802024-11-14T06:35:03.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = e964e10e-aace-4d31-a9b7-1541b9b60db4 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
49812024-11-14T06:35:03.532ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2768 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = e964e10e-aace-4d31-a9b7-1541b9b60db4 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
49822024-11-14T06:35:04.552ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = ffa4e8ef-5be6-45be-a8cb-d714803048b8 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
49832024-11-14T06:35:04.553ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = ffa4e8ef-5be6-45be-a8cb-d714803048b8 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
49842024-11-14T06:35:04.555ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2333 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = ffa4e8ef-5be6-45be-a8cb-d714803048b8 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
49852024-11-14T06:35:05.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 8af310eb-1b68-40a6-bd1c-4d4346fa79a7 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
49862024-11-14T06:35:05.578ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 8af310eb-1b68-40a6-bd1c-4d4346fa79a7 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
49872024-11-14T06:35:05.580ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2579 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 8af310eb-1b68-40a6-bd1c-4d4346fa79a7 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
49882024-11-14T06:35:06.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 8db97eca-d971-4d63-b126-a980ebdea0ae roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
49892024-11-14T06:35:06.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 8db97eca-d971-4d63-b126-a980ebdea0ae resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
49902024-11-14T06:35:06.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2273 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 8db97eca-d971-4d63-b126-a980ebdea0ae response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
49912024-11-14T06:35:07.606ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 576 local_addr = [fd00:1122:3344:101::c]:60882 method = GET remote_addr = [fd00:1122:3344:101::d]:64488 req_id = ca42a318-2ab9-4261-be5c-b4617b47b309 response_code = 200 uri = /80190dc3-d884-49a0-b9a3-38d31e8c655a
49922024-11-14T06:35:07.624ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 4206a6c8-c8ea-4ea1-90d8-c2502aefeb6b roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
49932024-11-14T06:35:07.625ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 4206a6c8-c8ea-4ea1-90d8-c2502aefeb6b resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
49942024-11-14T06:35:07.627ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2170 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 4206a6c8-c8ea-4ea1-90d8-c2502aefeb6b response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
49952024-11-14T06:35:08.646ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 55f68466-d5f3-4bf4-8a18-8e7cd1eb0f75 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
49962024-11-14T06:35:08.647ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 55f68466-d5f3-4bf4-8a18-8e7cd1eb0f75 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
49972024-11-14T06:35:08.649ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2534 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 55f68466-d5f3-4bf4-8a18-8e7cd1eb0f75 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
49982024-11-14T06:35:09.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 95 reason = Timeout
49992024-11-14T06:35:09.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 95 reason = Timeout
50002024-11-14T06:35:09.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50012024-11-14T06:35:09.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50022024-11-14T06:35:09.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50032024-11-14T06:35:09.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50042024-11-14T06:35:09.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50052024-11-14T06:35:09.578ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
50062024-11-14T06:35:09.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50072024-11-14T06:35:09.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50082024-11-14T06:35:09.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50092024-11-14T06:35:09.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50102024-11-14T06:35:09.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50112024-11-14T06:35:09.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
50122024-11-14T06:35:09.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50132024-11-14T06:35:09.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50142024-11-14T06:35:09.596ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
50152024-11-14T06:35:09.596ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.390067ms iteration = 95 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
50162024-11-14T06:35:09.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50172024-11-14T06:35:09.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50182024-11-14T06:35:09.602ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 28.208795ms iteration = 95 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
50192024-11-14T06:35:09.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = a08ffe63-5738-4082-ba8e-da306305c505 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50202024-11-14T06:35:09.670ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = a08ffe63-5738-4082-ba8e-da306305c505 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50212024-11-14T06:35:09.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1990 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = a08ffe63-5738-4082-ba8e-da306305c505 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50222024-11-14T06:35:10.693ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 8ea9c473-2e15-4a87-88ed-4b76b9cdca3c roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50232024-11-14T06:35:10.694ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 8ea9c473-2e15-4a87-88ed-4b76b9cdca3c resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50242024-11-14T06:35:10.696ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2351 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 8ea9c473-2e15-4a87-88ed-4b76b9cdca3c response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50252024-11-14T06:35:11.717ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 4164fd6e-6a5f-4868-b966-616889b9bd9f roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50262024-11-14T06:35:11.717ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 4164fd6e-6a5f-4868-b966-616889b9bd9f resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50272024-11-14T06:35:11.719ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2224 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 4164fd6e-6a5f-4868-b966-616889b9bd9f response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50282024-11-14T06:35:12.742ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = fd1b52c3-a930-4278-ae46-75987b255a7d roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50292024-11-14T06:35:12.742ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = fd1b52c3-a930-4278-ae46-75987b255a7d resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50302024-11-14T06:35:12.744ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2409 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = fd1b52c3-a930-4278-ae46-75987b255a7d response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50312024-11-14T06:35:13.765ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = fafa891f-9b9d-4cb9-9e1e-9e3ce9fb9ac3 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50322024-11-14T06:35:13.766ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = fafa891f-9b9d-4cb9-9e1e-9e3ce9fb9ac3 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50332024-11-14T06:35:13.767ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2326 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = fafa891f-9b9d-4cb9-9e1e-9e3ce9fb9ac3 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50342024-11-14T06:35:14.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 7d1e8c13-a459-4101-8d34-40402974415f roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50352024-11-14T06:35:14.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 7d1e8c13-a459-4101-8d34-40402974415f resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50362024-11-14T06:35:14.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2518 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 7d1e8c13-a459-4101-8d34-40402974415f response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50372024-11-14T06:35:15.813ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 54c85cad-f57a-4596-9ef6-c008208707df roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50382024-11-14T06:35:15.814ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 54c85cad-f57a-4596-9ef6-c008208707df resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50392024-11-14T06:35:15.816ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2784 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 54c85cad-f57a-4596-9ef6-c008208707df response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50402024-11-14T06:35:16.836ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 377cce19-2024-4a81-a141-3dea9851bc1f roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50412024-11-14T06:35:16.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 377cce19-2024-4a81-a141-3dea9851bc1f resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50422024-11-14T06:35:16.838ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2198 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 377cce19-2024-4a81-a141-3dea9851bc1f response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50432024-11-14T06:35:17.859ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = bd6b2d88-babd-4639-8826-c832577ba1ad roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50442024-11-14T06:35:17.859ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = bd6b2d88-babd-4639-8826-c832577ba1ad resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50452024-11-14T06:35:17.861ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2169 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = bd6b2d88-babd-4639-8826-c832577ba1ad response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50462024-11-14T06:35:18.884ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = be03d1fc-4ad6-494b-b368-5ea6f91e0a03 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50472024-11-14T06:35:18.884ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = be03d1fc-4ad6-494b-b368-5ea6f91e0a03 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50482024-11-14T06:35:18.886ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2503 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = be03d1fc-4ad6-494b-b368-5ea6f91e0a03 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50492024-11-14T06:35:19.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 96 reason = Timeout
50502024-11-14T06:35:19.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 96 reason = Timeout
50512024-11-14T06:35:19.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50522024-11-14T06:35:19.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50532024-11-14T06:35:19.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50542024-11-14T06:35:19.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50552024-11-14T06:35:19.576ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50562024-11-14T06:35:19.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50572024-11-14T06:35:19.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50582024-11-14T06:35:19.577ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.263721ms iteration = 96 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
50592024-11-14T06:35:19.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
50602024-11-14T06:35:19.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50612024-11-14T06:35:19.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50622024-11-14T06:35:19.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50632024-11-14T06:35:19.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50642024-11-14T06:35:19.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50652024-11-14T06:35:19.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
50662024-11-14T06:35:19.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50672024-11-14T06:35:19.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50682024-11-14T06:35:19.594ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
50692024-11-14T06:35:19.594ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.193485ms iteration = 96 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
50702024-11-14T06:35:19.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 9a1b229a-8abf-4f08-b65a-6ecff4e4e010 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50712024-11-14T06:35:19.908ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 9a1b229a-8abf-4f08-b65a-6ecff4e4e010 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50722024-11-14T06:35:19.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1944 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 9a1b229a-8abf-4f08-b65a-6ecff4e4e010 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50732024-11-14T06:35:20.930ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 65f70966-a6f5-4446-b1dc-4a6c636c124d roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50742024-11-14T06:35:20.931ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 65f70966-a6f5-4446-b1dc-4a6c636c124d resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50752024-11-14T06:35:20.932ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2044 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 65f70966-a6f5-4446-b1dc-4a6c636c124d response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50762024-11-14T06:35:21.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 7b6caddf-f2f7-46ca-8c76-250aaa1bbafa roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50772024-11-14T06:35:21.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 7b6caddf-f2f7-46ca-8c76-250aaa1bbafa resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50782024-11-14T06:35:21.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2494 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 7b6caddf-f2f7-46ca-8c76-250aaa1bbafa response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50792024-11-14T06:35:22.606ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 565 local_addr = [fd00:1122:3344:101::c]:60882 method = GET remote_addr = [fd00:1122:3344:101::d]:64488 req_id = eb0592e1-a709-4111-94c2-59b81609127b response_code = 200 uri = /80190dc3-d884-49a0-b9a3-38d31e8c655a
50802024-11-14T06:35:22.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = ca7615f0-7a96-4604-ba1d-38cf645b0370 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50812024-11-14T06:35:22.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = ca7615f0-7a96-4604-ba1d-38cf645b0370 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50822024-11-14T06:35:22.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2777 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = ca7615f0-7a96-4604-ba1d-38cf645b0370 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50832024-11-14T06:35:24.001ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = d1bb1e17-6f4a-4f2f-8dd0-edd5e8baf881 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50842024-11-14T06:35:24.001ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = d1bb1e17-6f4a-4f2f-8dd0-edd5e8baf881 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50852024-11-14T06:35:24.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2452 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = d1bb1e17-6f4a-4f2f-8dd0-edd5e8baf881 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50862024-11-14T06:35:25.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 8048790d-f7c3-49f3-bb5a-3239b035264f roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50872024-11-14T06:35:25.025ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 8048790d-f7c3-49f3-bb5a-3239b035264f resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50882024-11-14T06:35:25.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2669 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 8048790d-f7c3-49f3-bb5a-3239b035264f response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50892024-11-14T06:35:26.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 8fb484b8-31a9-418f-809a-8adda0db2aff roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50902024-11-14T06:35:26.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 8fb484b8-31a9-418f-809a-8adda0db2aff resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50912024-11-14T06:35:26.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2277 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 8fb484b8-31a9-418f-809a-8adda0db2aff response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50922024-11-14T06:35:27.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = b8e95bd8-9a24-441c-b649-3b95772cd23e roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50932024-11-14T06:35:27.072ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = b8e95bd8-9a24-441c-b649-3b95772cd23e resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50942024-11-14T06:35:27.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2369 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = b8e95bd8-9a24-441c-b649-3b95772cd23e response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50952024-11-14T06:35:28.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 587f03c3-fad7-4d91-8f6d-c499b3a294d4 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50962024-11-14T06:35:28.097ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 587f03c3-fad7-4d91-8f6d-c499b3a294d4 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50972024-11-14T06:35:28.099ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2563 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 587f03c3-fad7-4d91-8f6d-c499b3a294d4 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50982024-11-14T06:35:29.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = a9bc6f59-896d-4030-b711-5d3dc8c7fc9f roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
50992024-11-14T06:35:29.122ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = a9bc6f59-896d-4030-b711-5d3dc8c7fc9f resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
51002024-11-14T06:35:29.124ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2198 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = a9bc6f59-896d-4030-b711-5d3dc8c7fc9f response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
51012024-11-14T06:35:29.574ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 36 reason = Timeout
51022024-11-14T06:35:29.574ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 33 reason = Timeout
51032024-11-14T06:35:29.574ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51042024-11-14T06:35:29.574ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
51052024-11-14T06:35:29.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 33 reason = Timeout
51062024-11-14T06:35:29.574ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 17 reason = Timeout
51072024-11-14T06:35:29.574ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
51082024-11-14T06:35:29.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
51092024-11-14T06:35:29.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 18 reason = Timeout
51102024-11-14T06:35:29.574ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
51112024-11-14T06:35:29.574ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 1d98d624-72d4-4466-8fe7-990461a3f886
51122024-11-14T06:35:29.574ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.37\u{b5}s iteration = 18 status = {"enabled":false,"target_id":"1d98d624-72d4-4466-8fe7-990461a3f886"}
51132024-11-14T06:35:29.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 97 reason = Timeout
51142024-11-14T06:35:29.574ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 17 reason = Timeout
51152024-11-14T06:35:29.574ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
51162024-11-14T06:35:29.574ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 33 reason = Timeout
51172024-11-14T06:35:29.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51182024-11-14T06:35:29.574ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
51192024-11-14T06:35:29.574ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
51202024-11-14T06:35:29.574ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 33 reason = Timeout
51212024-11-14T06:35:29.574ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
51222024-11-14T06:35:29.574ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 17 reason = Timeout
51232024-11-14T06:35:29.574ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
51242024-11-14T06:35:29.574ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 19 reason = Timeout
51252024-11-14T06:35:29.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 97 reason = Timeout
51262024-11-14T06:35:29.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51272024-11-14T06:35:29.574ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 19 reason = Timeout
51282024-11-14T06:35:29.574ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 33 reason = Timeout
51292024-11-14T06:35:29.574ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
51302024-11-14T06:35:29.574ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
51312024-11-14T06:35:29.574ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 17 reason = Timeout
51322024-11-14T06:35:29.574ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51332024-11-14T06:35:29.574ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 33 reason = Timeout
51342024-11-14T06:35:29.574ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 33 reason = Timeout
51352024-11-14T06:35:29.574ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51362024-11-14T06:35:29.574ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 34 reason = Timeout
51372024-11-14T06:35:29.574ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 33 reason = Timeout
51382024-11-14T06:35:29.574ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51392024-11-14T06:35:29.575ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 17 reason = Timeout
51402024-11-14T06:35:29.575ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51412024-11-14T06:35:29.575ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 17 reason = Timeout
51422024-11-14T06:35:29.575ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 17 reason = Timeout
51432024-11-14T06:35:29.575ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 06:25:29.575003990 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
51442024-11-14T06:35:29.575ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 17 reason = Timeout
51452024-11-14T06:35:29.575ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
51462024-11-14T06:35:29.575ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
51472024-11-14T06:35:29.575ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
51482024-11-14T06:35:29.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 33 reason = Timeout
51492024-11-14T06:35:29.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
51502024-11-14T06:35:29.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 33 reason = Timeout
51512024-11-14T06:35:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
51522024-11-14T06:35:29.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
51532024-11-14T06:35:29.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 33 reason = Timeout
51542024-11-14T06:35:29.575ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 17 reason = Timeout
51552024-11-14T06:35:29.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 33 reason = Timeout
51562024-11-14T06:35:29.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
51572024-11-14T06:35:29.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
51582024-11-14T06:35:29.575ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 34 reason = Timeout
51592024-11-14T06:35:29.575ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
51602024-11-14T06:35:29.575ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
51612024-11-14T06:35:29.575ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51622024-11-14T06:35:29.575ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 17 reason = Timeout
51632024-11-14T06:35:29.575ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
51642024-11-14T06:35:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51652024-11-14T06:35:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
51662024-11-14T06:35:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51672024-11-14T06:35:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
51682024-11-14T06:35:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
51692024-11-14T06:35:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
51702024-11-14T06:35:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
51712024-11-14T06:35:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
51722024-11-14T06:35:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51732024-11-14T06:35:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51742024-11-14T06:35:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51752024-11-14T06:35:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51762024-11-14T06:35:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51772024-11-14T06:35:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
51782024-11-14T06:35:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
51792024-11-14T06:35:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
51802024-11-14T06:35:29.575ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("720ac48b-8596-4763-a661-482d124c0a16.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f40de7f6-4bc1-4578-baeb-b08e777b4bed.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f40de7f6-4bc1-4578-baeb-b08e777b4bed.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1986, tv_nsec: 133385334 } })
51812024-11-14T06:35:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51822024-11-14T06:35:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
51832024-11-14T06:35:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
51842024-11-14T06:35:29.575ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("36c202a9-b541-4083-88f5-ff6483340b34.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("78c1624f-34e7-40fb-a468-bb6354445b73.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d40cb6d7-78a4-49d0-ae26-45907e21e06a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d40cb6d7-78a4-49d0-ae26-45907e21e06a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1986, tv_nsec: 133432705 } })
51852024-11-14T06:35:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51862024-11-14T06:35:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
51872024-11-14T06:35:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
51882024-11-14T06:35:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
51892024-11-14T06:35:29.576ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
51902024-11-14T06:35:29.576ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.134881ms iteration = 17 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
51912024-11-14T06:35:29.576ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
51922024-11-14T06:35:29.576ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.274894ms iteration = 17 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
51932024-11-14T06:35:29.580ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51942024-11-14T06:35:29.581ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51952024-11-14T06:35:29.582ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
51962024-11-14T06:35:29.582ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
51972024-11-14T06:35:29.582ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 7.945048ms iteration = 33 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
51982024-11-14T06:35:29.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
51992024-11-14T06:35:29.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52002024-11-14T06:35:29.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
52012024-11-14T06:35:29.583ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52022024-11-14T06:35:29.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52032024-11-14T06:35:29.584ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1986, tv_nsec: 142324270 } })
52042024-11-14T06:35:29.584ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
52052024-11-14T06:35:29.585ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52062024-11-14T06:35:29.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52072024-11-14T06:35:29.585ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52082024-11-14T06:35:29.586ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52092024-11-14T06:35:29.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52102024-11-14T06:35:29.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52112024-11-14T06:35:29.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
52122024-11-14T06:35:29.587ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
52132024-11-14T06:35:29.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
52142024-11-14T06:35:29.589ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52152024-11-14T06:35:29.589ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52162024-11-14T06:35:29.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52172024-11-14T06:35:29.590ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52182024-11-14T06:35:29.591ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52192024-11-14T06:35:29.592ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
52202024-11-14T06:35:29.592ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52212024-11-14T06:35:29.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
52222024-11-14T06:35:29.594ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
52232024-11-14T06:35:29.594ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52242024-11-14T06:35:29.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52252024-11-14T06:35:29.595ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
52262024-11-14T06:35:29.595ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52272024-11-14T06:35:29.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52282024-11-14T06:35:29.595ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1986, tv_nsec: 153202563 } })
52292024-11-14T06:35:29.595ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52302024-11-14T06:35:29.595ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
52312024-11-14T06:35:29.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
52322024-11-14T06:35:29.595ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 06:25:29.575003990 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
52332024-11-14T06:35:29.595ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 20.981661ms iteration = 17 status = {"expiration":"2024-11-14T06:25:29.575003990Z","pruned":[]}
52342024-11-14T06:35:29.598ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52352024-11-14T06:35:29.598ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 23.536018ms iteration = 33 status = {"errors":[],"garbage_collect_requested":[]}
52362024-11-14T06:35:29.599ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 24.264952ms iteration = 17 status = {"errors":[],"found_port_ok":[]}
52372024-11-14T06:35:29.600ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
52382024-11-14T06:35:29.600ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52392024-11-14T06:35:29.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52402024-11-14T06:35:29.602ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52412024-11-14T06:35:29.602ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52422024-11-14T06:35:29.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52432024-11-14T06:35:29.605ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
52442024-11-14T06:35:29.610ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52452024-11-14T06:35:29.611ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52462024-11-14T06:35:29.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52472024-11-14T06:35:29.611ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1986, tv_nsec: 169650179 } })
52482024-11-14T06:35:29.612ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
52492024-11-14T06:35:29.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52502024-11-14T06:35:29.613ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
52512024-11-14T06:35:29.613ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
52522024-11-14T06:35:29.613ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
52532024-11-14T06:35:29.613ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52542024-11-14T06:35:29.613ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52552024-11-14T06:35:29.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52562024-11-14T06:35:29.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
52572024-11-14T06:35:29.613ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52582024-11-14T06:35:29.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52592024-11-14T06:35:29.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
52602024-11-14T06:35:29.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52612024-11-14T06:35:29.615ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52622024-11-14T06:35:29.616ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52632024-11-14T06:35:29.616ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52642024-11-14T06:35:29.620ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
52652024-11-14T06:35:29.620ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52662024-11-14T06:35:29.620ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
52672024-11-14T06:35:29.620ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52682024-11-14T06:35:29.620ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
52692024-11-14T06:35:29.620ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52702024-11-14T06:35:29.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52712024-11-14T06:35:29.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
52722024-11-14T06:35:29.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52732024-11-14T06:35:29.624ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
52742024-11-14T06:35:29.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
52752024-11-14T06:35:29.636ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
52762024-11-14T06:35:29.636ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
52772024-11-14T06:35:29.636ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
52782024-11-14T06:35:29.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
52792024-11-14T06:35:29.636ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
52802024-11-14T06:35:29.636ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 62.170657ms iteration = 97 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
52812024-11-14T06:35:29.641ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
52822024-11-14T06:35:29.641ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
52832024-11-14T06:35:29.641ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
52842024-11-14T06:35:29.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
52852024-11-14T06:35:29.643ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 68.353462ms iteration = 33 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
52862024-11-14T06:35:29.644ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 69.647296ms iteration = 33 status = {"errors":[],"records_set_to_done":[]}
52872024-11-14T06:35:29.644ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52882024-11-14T06:35:29.647ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
52892024-11-14T06:35:29.649ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
52902024-11-14T06:35:29.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
52912024-11-14T06:35:29.652ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
52922024-11-14T06:35:29.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
52932024-11-14T06:35:29.653ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
52942024-11-14T06:35:29.653ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
52952024-11-14T06:35:29.653ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 78.360009ms iteration = 17 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
52962024-11-14T06:35:29.653ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
52972024-11-14T06:35:29.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
52982024-11-14T06:35:29.653ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52992024-11-14T06:35:29.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53002024-11-14T06:35:29.654ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
53012024-11-14T06:35:29.654ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
53022024-11-14T06:35:29.654ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 79.181234ms iteration = 17 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
53032024-11-14T06:35:29.656ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53042024-11-14T06:35:29.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53052024-11-14T06:35:29.657ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53062024-11-14T06:35:29.658ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53072024-11-14T06:35:29.660ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 85.326668ms iteration = 97 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
53082024-11-14T06:35:29.660ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
53092024-11-14T06:35:29.660ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53102024-11-14T06:35:29.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53112024-11-14T06:35:29.661ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
53122024-11-14T06:35:29.661ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 86.617743ms iteration = 33 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
53132024-11-14T06:35:29.662ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 27a56cb4-44ff-4d5b-931e-1c2c0642844d, lookup_type: ById(27a56cb4-44ff-4d5b-931e-1c2c0642844d) } result = Ok(())
53142024-11-14T06:35:29.663ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53152024-11-14T06:35:29.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53162024-11-14T06:35:29.665ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 90.24212ms iteration = 33 status = 0
53172024-11-14T06:35:29.669ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
53182024-11-14T06:35:29.669ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 30e11b92-f705-4c8e-bce7-d646f8ce00cf dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
53192024-11-14T06:35:29.669ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53202024-11-14T06:35:29.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53212024-11-14T06:35:29.669ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 95.144201ms iteration = 36 status = {"physical_disks_added":0}
53222024-11-14T06:35:29.670ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
53232024-11-14T06:35:29.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
53242024-11-14T06:35:29.671ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53252024-11-14T06:35:29.672ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53262024-11-14T06:35:29.675ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
53272024-11-14T06:35:29.675ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
53282024-11-14T06:35:29.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
53292024-11-14T06:35:29.675ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
53302024-11-14T06:35:29.675ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53312024-11-14T06:35:29.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53322024-11-14T06:35:29.678ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
53332024-11-14T06:35:29.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
53342024-11-14T06:35:29.678ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 30e11b92-f705-4c8e-bce7-d646f8ce00cf dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
53352024-11-14T06:35:29.678ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
53362024-11-14T06:35:29.679ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-14 06:19:30.340423 UTC dns_group = internal generation = 1
53372024-11-14T06:35:29.679ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 104.258361ms iteration = 17 status = {"generation":1}
53382024-11-14T06:35:29.680ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
53392024-11-14T06:35:29.680ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 106.072434ms iteration = 17 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
53402024-11-14T06:35:29.684ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T06:19:27.309503Z, time_modified: 2024-11-14T06:19:27.309503Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, db_silo: Silo { identity: SiloIdentity { id: 95153e51-68aa-4bd4-8e65-b8164172811d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T06:19:31.569300Z, time_modified: 2024-11-14T06:19:31.569300Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, db_silo: Silo { identity: SiloIdentity { id: 95153e51-68aa-4bd4-8e65-b8164172811d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T06:19:31.569300Z, time_modified: 2024-11-14T06:19:31.569300Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89" }] }) }
53412024-11-14T06:35:29.684ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 109.694401ms iteration = 17 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"95153e51-68aa-4bd4-8e65-b8164172811d","tls_certs":["3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89"]}},"default_endpoint":{"silo_id":"95153e51-68aa-4bd4-8e65-b8164172811d","tls_certs":["3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
53422024-11-14T06:35:29.685ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53432024-11-14T06:35:29.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53442024-11-14T06:35:29.688ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
53452024-11-14T06:35:29.688ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
53462024-11-14T06:35:29.688ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 113.833199ms iteration = 33 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
53472024-11-14T06:35:29.694ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
53482024-11-14T06:35:29.694ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
53492024-11-14T06:35:29.694ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
53502024-11-14T06:35:29.694ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53512024-11-14T06:35:29.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53522024-11-14T06:35:29.695ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53532024-11-14T06:35:29.696ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 120.929241ms iteration = 33 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
53542024-11-14T06:35:29.697ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53552024-11-14T06:35:29.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53562024-11-14T06:35:29.698ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
53572024-11-14T06:35:29.698ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53582024-11-14T06:35:29.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53592024-11-14T06:35:29.699ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 123.971568ms iteration = 33 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
53602024-11-14T06:35:29.699ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53612024-11-14T06:35:29.700ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
53622024-11-14T06:35:29.700ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = c6d59938-b455-4e7b-9d17-0d6427a65b9c dns_zone_name = oxide.test found_so_far = 0 version = 2
53632024-11-14T06:35:29.700ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53642024-11-14T06:35:29.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53652024-11-14T06:35:29.701ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53662024-11-14T06:35:29.702ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
53672024-11-14T06:35:29.702ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
53682024-11-14T06:35:29.702ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53692024-11-14T06:35:29.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53702024-11-14T06:35:29.704ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53712024-11-14T06:35:29.706ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
53722024-11-14T06:35:29.706ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53732024-11-14T06:35:29.706ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
53742024-11-14T06:35:29.706ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53752024-11-14T06:35:29.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53762024-11-14T06:35:29.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53772024-11-14T06:35:29.707ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = c6d59938-b455-4e7b-9d17-0d6427a65b9c dns_zone_name = oxide.test found_so_far = 1 version = 2
53782024-11-14T06:35:29.707ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
53792024-11-14T06:35:29.707ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-14 06:19:31.616543 UTC dns_group = external generation = 2
53802024-11-14T06:35:29.707ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 132.627739ms iteration = 17 status = {"generation":2}
53812024-11-14T06:35:29.721ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
53822024-11-14T06:35:29.733ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
53832024-11-14T06:35:29.733ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
53842024-11-14T06:35:29.733ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ad02959e-7dce-430c-9196-96bb24e49c14", "content-length": "26", "date": "Thu, 14 Nov 2024 06:35:29 GMT"} })
53852024-11-14T06:35:29.733ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
53862024-11-14T06:35:29.734ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
53872024-11-14T06:35:29.753ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
53882024-11-14T06:35:29.753ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
53892024-11-14T06:35:29.753ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a4f2b3e-5329-467f-96cd-60266745a6a7", "content-length": "26", "date": "Thu, 14 Nov 2024 06:35:29 GMT"} })
53902024-11-14T06:35:29.753ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
53912024-11-14T06:35:29.755ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
53922024-11-14T06:35:29.860ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 zone_address = fd00:1122:3344:101::2
53932024-11-14T06:35:29.860ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
53942024-11-14T06:35:29.860ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c3177652-4a0d-46af-a25e-a5830822e0eb", "content-length": "26", "date": "Thu, 14 Nov 2024 06:35:29 GMT"} })
53952024-11-14T06:35:29.860ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
53962024-11-14T06:35:29.862ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
53972024-11-14T06:35:29.903ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
53982024-11-14T06:35:29.907ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
53992024-11-14T06:35:29.907ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "20b6eb12-bb22-409a-9d28-1601a90c1264", "date": "Thu, 14 Nov 2024 06:35:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
54002024-11-14T06:35:29.907ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
54012024-11-14T06:35:29.909ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "33cb4de6-b844-4746-b414-5cba2888b232", "date": "Thu, 14 Nov 2024 06:35:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
54022024-11-14T06:35:29.909ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
54032024-11-14T06:35:29.911ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
54042024-11-14T06:35:29.911ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 336.558754ms iteration = 19 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
54052024-11-14T06:35:29.925ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 350.349811ms iteration = 33 status = {}
54062024-11-14T06:35:29.940ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
54072024-11-14T06:35:29.940ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
54082024-11-14T06:35:29.941ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "bd37ff4c-fc2e-49ed-901a-477efc766552", "content-length": "372", "date": "Thu, 14 Nov 2024 06:35:29 GMT"} })
54092024-11-14T06:35:29.941ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54102024-11-14T06:35:29.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54112024-11-14T06:35:29.943ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
54122024-11-14T06:35:29.943ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
54132024-11-14T06:35:29.943ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "fddcc874-b72d-41b2-95fd-fdfcb19f29ef", "content-length": "2", "date": "Thu, 14 Nov 2024 06:35:29 GMT"} })
54142024-11-14T06:35:29.943ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5e10dde5-f4ec-4be0-8af7-a66c4bc31404", "content-length": "691", "date": "Thu, 14 Nov 2024 06:35:29 GMT"} })
54152024-11-14T06:35:29.943ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
54162024-11-14T06:35:29.943ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
54172024-11-14T06:35:29.943ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
54182024-11-14T06:35:29.947ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
54192024-11-14T06:35:29.947ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 372.791479ms iteration = 34 status = {}
54202024-11-14T06:35:29.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
54212024-11-14T06:35:29.950ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 375.240584ms iteration = 33 status = null
54222024-11-14T06:35:29.955ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
54232024-11-14T06:35:29.955ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
54242024-11-14T06:35:29.955ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d16c636f-5433-4ece-bca9-b443dbeeecba", "date": "Thu, 14 Nov 2024 06:35:29 GMT"} })
54252024-11-14T06:35:29.955ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54262024-11-14T06:35:29.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54272024-11-14T06:35:29.958ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54282024-11-14T06:35:29.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54292024-11-14T06:35:29.961ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54302024-11-14T06:35:29.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54312024-11-14T06:35:29.965ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
54322024-11-14T06:35:29.965ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
54332024-11-14T06:35:29.965ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "12ef50dd-ee57-434a-8dc5-e4cc8a1a4c44", "date": "Thu, 14 Nov 2024 06:35:29 GMT"} })
54342024-11-14T06:35:29.968ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 392.906033ms iteration = 34 status = {}
54352024-11-14T06:35:29.985ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
54362024-11-14T06:35:29.986ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "275ce540-586b-4943-b241-4b007aca9625", "date": "Thu, 14 Nov 2024 06:35:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
54372024-11-14T06:35:29.986ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
54382024-11-14T06:35:29.988ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "e78214c6-dd38-4f49-9980-f56cd45621c0", "date": "Thu, 14 Nov 2024 06:35:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
54392024-11-14T06:35:29.988ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
54402024-11-14T06:35:29.990ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "94052dde-65fa-41a9-a05b-b340e5fadc33", "date": "Thu, 14 Nov 2024 06:35:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
54412024-11-14T06:35:29.990ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
54422024-11-14T06:35:29.992ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
54432024-11-14T06:35:29.992ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 417.749106ms iteration = 19 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
54442024-11-14T06:35:30.039ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54452024-11-14T06:35:30.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54462024-11-14T06:35:30.041ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: cecfafa4-4697-4aa6-949f-23c34aa9d5bd, rack_id: f391bffc-9f2b-4c87-85cd-2718afa7cb93, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(58c91208-be0a-4936-a7c2-2ae07694e16d) } rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
54472024-11-14T06:35:30.041ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54482024-11-14T06:35:30.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54492024-11-14T06:35:30.049ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
54502024-11-14T06:35:30.049ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f8f7dfc-7834-4c57-bf56-eb5a4fece88a", "content-length": "134", "date": "Thu, 14 Nov 2024 06:35:29 GMT"} })
54512024-11-14T06:35:30.049ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
54522024-11-14T06:35:30.049ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 58c91208-be0a-4936-a7c2-2ae07694e16d
54532024-11-14T06:35:30.049ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
54542024-11-14T06:35:30.049ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
54552024-11-14T06:35:30.049ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
54562024-11-14T06:35:30.049ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
54572024-11-14T06:35:30.049ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
54582024-11-14T06:35:30.049ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
54592024-11-14T06:35:30.050ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
54602024-11-14T06:35:30.050ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
54612024-11-14T06:35:30.050ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
54622024-11-14T06:35:30.050ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54632024-11-14T06:35:30.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54642024-11-14T06:35:30.051ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
54652024-11-14T06:35:30.051ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c3118c15-0600-485f-9013-c56b0bccc034", "content-length": "2", "date": "Thu, 14 Nov 2024 06:35:29 GMT"} })
54662024-11-14T06:35:30.051ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
54672024-11-14T06:35:30.051ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "322581d8-6075-45be-93c0-f520e29a3d07", "content-length": "52", "date": "Thu, 14 Nov 2024 06:35:29 GMT"} })
54682024-11-14T06:35:30.051ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
54692024-11-14T06:35:30.051ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
54702024-11-14T06:35:30.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = b37f0cce-6347-4b96-8371-031b9a9919f6 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
54712024-11-14T06:35:30.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = b37f0cce-6347-4b96-8371-031b9a9919f6 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
54722024-11-14T06:35:30.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2307 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = b37f0cce-6347-4b96-8371-031b9a9919f6 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
54732024-11-14T06:35:30.290ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a3d16499-9427-43a8-9577-7bfc35e604eb", "date": "Thu, 14 Nov 2024 06:35:29 GMT"} })
54742024-11-14T06:35:30.290ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch = Switch0
54752024-11-14T06:35:30.290ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
54762024-11-14T06:35:30.291ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b82c4724-9b5f-452e-9f0c-bb16d0841f9f", "content-length": "682", "date": "Thu, 14 Nov 2024 06:35:30 GMT"} })
54772024-11-14T06:35:30.291ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54782024-11-14T06:35:30.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54792024-11-14T06:35:30.295ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54802024-11-14T06:35:30.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54812024-11-14T06:35:30.298ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54822024-11-14T06:35:30.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54832024-11-14T06:35:30.300ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54842024-11-14T06:35:30.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54852024-11-14T06:35:30.307ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 732.731179ms iteration = 33 status = {}
54862024-11-14T06:35:30.520ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
54872024-11-14T06:35:30.520ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
54882024-11-14T06:35:30.550ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
54892024-11-14T06:35:30.550ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:38749
54902024-11-14T06:35:30.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:38749 req_id = b6c15d28-2312-4acb-b641-5c77d62c0fde roles = RoleSet { roles: {} } uri = /metrics/producers
54912024-11-14T06:35:30.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:38749 req_id = b6c15d28-2312-4acb-b641-5c77d62c0fde resource = Database result = Ok(()) uri = /metrics/producers
54922024-11-14T06:35:30.593ZINFOnexus: assigned collector to new producer collector_id = d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6 file = nexus/src/app/oximeter.rs:76 producer_id = 80190dc3-d884-49a0-b9a3-38d31e8c655a
54932024-11-14T06:35:30.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42675 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:38749 req_id = b6c15d28-2312-4acb-b641-5c77d62c0fde response_code = 201 uri = /metrics/producers
54942024-11-14T06:35:30.593ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "b6c15d28-2312-4acb-b641-5c77d62c0fde", "content-length": "41", "date": "Thu, 14 Nov 2024 06:35:30 GMT"} })
54952024-11-14T06:35:30.594ZDEBGnexus (producer-registration-task): registered with nexus successfully
54962024-11-14T06:35:30.594ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
54972024-11-14T06:35:31.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 2ff49af7-9f28-43c8-94cc-2d529f8d9203 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
54982024-11-14T06:35:31.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 2ff49af7-9f28-43c8-94cc-2d529f8d9203 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
54992024-11-14T06:35:31.174ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2047 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 2ff49af7-9f28-43c8-94cc-2d529f8d9203 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
55002024-11-14T06:35:32.196ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f5377f41-741f-46c4-919c-e1947e8ca221 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
55012024-11-14T06:35:32.196ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f5377f41-741f-46c4-919c-e1947e8ca221 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
55022024-11-14T06:35:32.198ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2159 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f5377f41-741f-46c4-919c-e1947e8ca221 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
55032024-11-14T06:35:32.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36021 req_id = 72631a46-10bc-4ca8-ba3d-468f8b3eacaf roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/12?limit=100
55042024-11-14T06:35:32.227ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36021 req_id = 72631a46-10bc-4ca8-ba3d-468f8b3eacaf resource = Database result = Ok(()) uri = /nat/ipv4/changeset/12?limit=100
55052024-11-14T06:35:32.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3127 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36021 req_id = 72631a46-10bc-4ca8-ba3d-468f8b3eacaf response_code = 200 uri = /nat/ipv4/changeset/12?limit=100
55062024-11-14T06:35:33.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 200fb7a8-7647-432f-9f31-9cfffd519394 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
55072024-11-14T06:35:33.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 200fb7a8-7647-432f-9f31-9cfffd519394 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
55082024-11-14T06:35:33.222ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2074 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 200fb7a8-7647-432f-9f31-9cfffd519394 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
55092024-11-14T06:35:34.245ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 4e4cf26a-5f16-441a-918d-ea14e01c9e53 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
55102024-11-14T06:35:34.245ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 4e4cf26a-5f16-441a-918d-ea14e01c9e53 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
55112024-11-14T06:35:34.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2374 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 4e4cf26a-5f16-441a-918d-ea14e01c9e53 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
55122024-11-14T06:35:35.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 9ff29202-9abd-4756-8f40-9c477bdeece6 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
55132024-11-14T06:35:35.267ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 9ff29202-9abd-4756-8f40-9c477bdeece6 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
55142024-11-14T06:35:35.270ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2508 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 9ff29202-9abd-4756-8f40-9c477bdeece6 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
55152024-11-14T06:35:36.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = aa91b0f5-c36e-4b25-b538-1adc1b9e6920 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
55162024-11-14T06:35:36.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = aa91b0f5-c36e-4b25-b538-1adc1b9e6920 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
55172024-11-14T06:35:36.293ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2507 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = aa91b0f5-c36e-4b25-b538-1adc1b9e6920 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
55182024-11-14T06:35:37.314ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 38dfb3df-16b0-4d24-83c3-00d3baf00ba5 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
55192024-11-14T06:35:37.315ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 38dfb3df-16b0-4d24-83c3-00d3baf00ba5 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
55202024-11-14T06:35:37.317ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2471 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 38dfb3df-16b0-4d24-83c3-00d3baf00ba5 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
55212024-11-14T06:35:37.606ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 552 local_addr = [fd00:1122:3344:101::c]:60882 method = GET remote_addr = [fd00:1122:3344:101::d]:64488 req_id = 496d21a5-9756-41bd-b517-8509844fbb06 response_code = 200 uri = /80190dc3-d884-49a0-b9a3-38d31e8c655a
55222024-11-14T06:35:38.339ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 21499867-5454-4c9a-ba37-a82cc9452a71 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
55232024-11-14T06:35:38.339ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 21499867-5454-4c9a-ba37-a82cc9452a71 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
55242024-11-14T06:35:38.341ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1849 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 21499867-5454-4c9a-ba37-a82cc9452a71 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
55252024-11-14T06:35:39.363ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 02c1fb33-d111-4139-a8b1-23f33c55727f roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
55262024-11-14T06:35:39.363ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 02c1fb33-d111-4139-a8b1-23f33c55727f resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
55272024-11-14T06:35:39.365ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2581 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 02c1fb33-d111-4139-a8b1-23f33c55727f response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
55282024-11-14T06:35:39.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 98 reason = Timeout
55292024-11-14T06:35:39.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 98 reason = Timeout
55302024-11-14T06:35:39.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55312024-11-14T06:35:39.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55322024-11-14T06:35:39.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55332024-11-14T06:35:39.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55342024-11-14T06:35:39.576ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55352024-11-14T06:35:39.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55362024-11-14T06:35:39.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55372024-11-14T06:35:39.578ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.528966ms iteration = 98 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
55382024-11-14T06:35:39.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
55392024-11-14T06:35:39.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55402024-11-14T06:35:39.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55412024-11-14T06:35:39.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55422024-11-14T06:35:39.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55432024-11-14T06:35:39.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55442024-11-14T06:35:39.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
55452024-11-14T06:35:39.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55462024-11-14T06:35:39.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55472024-11-14T06:35:39.596ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
55482024-11-14T06:35:39.596ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.191964ms iteration = 98 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
55492024-11-14T06:35:40.385ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 903c5eae-78c9-4cad-95ad-d280bc8c2812 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
55502024-11-14T06:35:40.386ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 903c5eae-78c9-4cad-95ad-d280bc8c2812 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
55512024-11-14T06:35:40.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2327 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 903c5eae-78c9-4cad-95ad-d280bc8c2812 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
55522024-11-14T06:35:41.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = fe9b6454-5a70-47c2-a90c-cc34079c8309 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
55532024-11-14T06:35:41.409ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = fe9b6454-5a70-47c2-a90c-cc34079c8309 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
55542024-11-14T06:35:41.411ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2372 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = fe9b6454-5a70-47c2-a90c-cc34079c8309 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
55552024-11-14T06:35:42.434ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 09f8aeb1-54a8-4a28-bf56-8c0485e5b228 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
55562024-11-14T06:35:42.435ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 09f8aeb1-54a8-4a28-bf56-8c0485e5b228 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
55572024-11-14T06:35:42.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2270 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 09f8aeb1-54a8-4a28-bf56-8c0485e5b228 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
55582024-11-14T06:35:43.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 7c70f9ba-3848-458d-866f-c165995054ea roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
55592024-11-14T06:35:43.458ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 7c70f9ba-3848-458d-866f-c165995054ea resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
55602024-11-14T06:35:43.460ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2655 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 7c70f9ba-3848-458d-866f-c165995054ea response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
55612024-11-14T06:35:44.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = c3acb9c2-8cae-4f86-8649-40e64af4103f roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
55622024-11-14T06:35:44.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = c3acb9c2-8cae-4f86-8649-40e64af4103f resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
55632024-11-14T06:35:44.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2466 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = c3acb9c2-8cae-4f86-8649-40e64af4103f response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
55642024-11-14T06:35:45.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 6b6b9363-4b49-4fc4-85d8-98752b01c78a roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
55652024-11-14T06:35:45.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 6b6b9363-4b49-4fc4-85d8-98752b01c78a resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
55662024-11-14T06:35:45.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2235 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 6b6b9363-4b49-4fc4-85d8-98752b01c78a response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
55672024-11-14T06:35:46.529ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 86d46c08-613d-4a52-bd9e-5167a11972f3 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
55682024-11-14T06:35:46.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 86d46c08-613d-4a52-bd9e-5167a11972f3 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
55692024-11-14T06:35:46.531ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2250 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 86d46c08-613d-4a52-bd9e-5167a11972f3 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
55702024-11-14T06:35:47.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 59baf544-be1a-420a-a5f5-9cbfc2ca30f2 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
55712024-11-14T06:35:47.552ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 59baf544-be1a-420a-a5f5-9cbfc2ca30f2 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
55722024-11-14T06:35:47.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1982 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 59baf544-be1a-420a-a5f5-9cbfc2ca30f2 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
55732024-11-14T06:35:48.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = bf59ec7e-e49c-4e56-9e73-647e7248a75c roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
55742024-11-14T06:35:48.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = bf59ec7e-e49c-4e56-9e73-647e7248a75c resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
55752024-11-14T06:35:48.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2360 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = bf59ec7e-e49c-4e56-9e73-647e7248a75c response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
55762024-11-14T06:35:49.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 99 reason = Timeout
55772024-11-14T06:35:49.575ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 99 reason = Timeout
55782024-11-14T06:35:49.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55792024-11-14T06:35:49.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55802024-11-14T06:35:49.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55812024-11-14T06:35:49.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55822024-11-14T06:35:49.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55832024-11-14T06:35:49.577ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55842024-11-14T06:35:49.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55852024-11-14T06:35:49.579ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.227039ms iteration = 99 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
55862024-11-14T06:35:49.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
55872024-11-14T06:35:49.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55882024-11-14T06:35:49.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55892024-11-14T06:35:49.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55902024-11-14T06:35:49.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55912024-11-14T06:35:49.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55922024-11-14T06:35:49.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
55932024-11-14T06:35:49.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55942024-11-14T06:35:49.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55952024-11-14T06:35:49.592ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
55962024-11-14T06:35:49.592ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.608818ms iteration = 99 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
55972024-11-14T06:35:49.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = de8d4ab2-476a-4615-92e7-7ab86225bbe0 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
55982024-11-14T06:35:49.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = de8d4ab2-476a-4615-92e7-7ab86225bbe0 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
55992024-11-14T06:35:49.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1838 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = de8d4ab2-476a-4615-92e7-7ab86225bbe0 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
56002024-11-14T06:35:50.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f49a554f-4403-409e-ba26-c21ef2e02bc2 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
56012024-11-14T06:35:50.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f49a554f-4403-409e-ba26-c21ef2e02bc2 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
56022024-11-14T06:35:50.624ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2528 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f49a554f-4403-409e-ba26-c21ef2e02bc2 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
56032024-11-14T06:35:51.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 1c082486-7e3e-457d-bc98-810b6047cd3a roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
56042024-11-14T06:35:51.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 1c082486-7e3e-457d-bc98-810b6047cd3a resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
56052024-11-14T06:35:51.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1850 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 1c082486-7e3e-457d-bc98-810b6047cd3a response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
56062024-11-14T06:35:52.606ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 555 local_addr = [fd00:1122:3344:101::c]:60882 method = GET remote_addr = [fd00:1122:3344:101::d]:64488 req_id = 9c75257e-a4f0-4051-bc19-d61cd1df203f response_code = 200 uri = /80190dc3-d884-49a0-b9a3-38d31e8c655a
56072024-11-14T06:35:52.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 9a8d9833-4e10-4c1e-8420-5a1a600de472 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
56082024-11-14T06:35:52.670ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 9a8d9833-4e10-4c1e-8420-5a1a600de472 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
56092024-11-14T06:35:52.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2755 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 9a8d9833-4e10-4c1e-8420-5a1a600de472 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
56102024-11-14T06:35:53.695ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 34b48686-8379-4c6a-824b-a1da3d3dce8a roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
56112024-11-14T06:35:53.695ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 34b48686-8379-4c6a-824b-a1da3d3dce8a resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
56122024-11-14T06:35:53.697ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2266 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 34b48686-8379-4c6a-824b-a1da3d3dce8a response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
56132024-11-14T06:35:54.721ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = d361ddda-2ca4-498c-b172-a5983f267ee3 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
56142024-11-14T06:35:54.721ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = d361ddda-2ca4-498c-b172-a5983f267ee3 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
56152024-11-14T06:35:54.723ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2098 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = d361ddda-2ca4-498c-b172-a5983f267ee3 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
56162024-11-14T06:35:55.743ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 08059657-c1a9-442e-975c-5aef8905a1f6 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
56172024-11-14T06:35:55.744ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 08059657-c1a9-442e-975c-5aef8905a1f6 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
56182024-11-14T06:35:55.746ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2930 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 08059657-c1a9-442e-975c-5aef8905a1f6 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
56192024-11-14T06:35:56.768ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 8cbee489-e38c-47d3-a680-39a1d5ff3be7 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
56202024-11-14T06:35:56.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 8cbee489-e38c-47d3-a680-39a1d5ff3be7 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
56212024-11-14T06:35:56.770ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2080 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 8cbee489-e38c-47d3-a680-39a1d5ff3be7 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
56222024-11-14T06:35:57.791ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 0d893dca-7ac5-419a-bfd3-4b9c75218a7d roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
56232024-11-14T06:35:57.792ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 0d893dca-7ac5-419a-bfd3-4b9c75218a7d resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
56242024-11-14T06:35:57.793ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2129 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 0d893dca-7ac5-419a-bfd3-4b9c75218a7d response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
56252024-11-14T06:35:58.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = e97c8d00-bf90-4101-a633-bcd112870a92 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
56262024-11-14T06:35:58.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = e97c8d00-bf90-4101-a633-bcd112870a92 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
56272024-11-14T06:35:58.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2919 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = e97c8d00-bf90-4101-a633-bcd112870a92 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
56282024-11-14T06:35:59.574ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 34 reason = Timeout
56292024-11-14T06:35:59.574ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56302024-11-14T06:35:59.574ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 34 reason = Timeout
56312024-11-14T06:35:59.574ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 34 reason = Timeout
56322024-11-14T06:35:59.574ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
56332024-11-14T06:35:59.574ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 34 reason = Timeout
56342024-11-14T06:35:59.574ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
56352024-11-14T06:35:59.574ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
56362024-11-14T06:35:59.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 100 reason = Timeout
56372024-11-14T06:35:59.574ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 34 reason = Timeout
56382024-11-14T06:35:59.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56392024-11-14T06:35:59.574ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 34 reason = Timeout
56402024-11-14T06:35:59.574ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56412024-11-14T06:35:59.574ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
56422024-11-14T06:35:59.574ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 100 reason = Timeout
56432024-11-14T06:35:59.574ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 37 reason = Timeout
56442024-11-14T06:35:59.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56452024-11-14T06:35:59.574ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
56462024-11-14T06:35:59.574ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 34 reason = Timeout
56472024-11-14T06:35:59.574ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
56482024-11-14T06:35:59.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 34 reason = Timeout
56492024-11-14T06:35:59.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
56502024-11-14T06:35:59.574ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 35 reason = Timeout
56512024-11-14T06:35:59.574ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56522024-11-14T06:35:59.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56532024-11-14T06:35:59.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
56542024-11-14T06:35:59.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
56552024-11-14T06:35:59.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
56562024-11-14T06:35:59.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
56572024-11-14T06:35:59.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56582024-11-14T06:35:59.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56592024-11-14T06:35:59.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
56602024-11-14T06:35:59.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56612024-11-14T06:35:59.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56622024-11-14T06:35:59.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
56632024-11-14T06:35:59.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 34 reason = Timeout
56642024-11-14T06:35:59.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 34 reason = Timeout
56652024-11-14T06:35:59.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
56662024-11-14T06:35:59.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
56672024-11-14T06:35:59.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 34 reason = Timeout
56682024-11-14T06:35:59.575ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 34 reason = Timeout
56692024-11-14T06:35:59.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
56702024-11-14T06:35:59.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
56712024-11-14T06:35:59.575ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 35 reason = Timeout
56722024-11-14T06:35:59.575ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
56732024-11-14T06:35:59.575ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56742024-11-14T06:35:59.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
56752024-11-14T06:35:59.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
56762024-11-14T06:35:59.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56772024-11-14T06:35:59.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
56782024-11-14T06:35:59.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
56792024-11-14T06:35:59.577ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56802024-11-14T06:35:59.578ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2016, tv_nsec: 135815259 } })
56812024-11-14T06:35:59.578ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56822024-11-14T06:35:59.578ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
56832024-11-14T06:35:59.578ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
56842024-11-14T06:35:59.578ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
56852024-11-14T06:35:59.578ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56862024-11-14T06:35:59.578ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
56872024-11-14T06:35:59.578ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.095467ms iteration = 34 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
56882024-11-14T06:35:59.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
56892024-11-14T06:35:59.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
56902024-11-14T06:35:59.580ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56912024-11-14T06:35:59.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56922024-11-14T06:35:59.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
56932024-11-14T06:35:59.580ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
56942024-11-14T06:35:59.581ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
56952024-11-14T06:35:59.581ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
56962024-11-14T06:35:59.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
56972024-11-14T06:35:59.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
56982024-11-14T06:35:59.582ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56992024-11-14T06:35:59.582ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57002024-11-14T06:35:59.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57012024-11-14T06:35:59.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57022024-11-14T06:35:59.584ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2016, tv_nsec: 142047675 } })
57032024-11-14T06:35:59.584ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
57042024-11-14T06:35:59.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
57052024-11-14T06:35:59.585ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57062024-11-14T06:35:59.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57072024-11-14T06:35:59.586ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
57082024-11-14T06:35:59.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57092024-11-14T06:35:59.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57102024-11-14T06:35:59.587ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 11.805049ms iteration = 34 status = {"errors":[],"garbage_collect_requested":[]}
57112024-11-14T06:35:59.588ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57122024-11-14T06:35:59.588ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
57132024-11-14T06:35:59.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
57142024-11-14T06:35:59.590ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
57152024-11-14T06:35:59.590ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
57162024-11-14T06:35:59.590ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
57172024-11-14T06:35:59.590ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
57182024-11-14T06:35:59.590ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57192024-11-14T06:35:59.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
57202024-11-14T06:35:59.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57212024-11-14T06:35:59.591ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2016, tv_nsec: 148779691 } })
57222024-11-14T06:35:59.591ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
57232024-11-14T06:35:59.592ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57242024-11-14T06:35:59.593ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 18.620507ms iteration = 100 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57252024-11-14T06:35:59.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57262024-11-14T06:35:59.593ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57272024-11-14T06:35:59.593ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57282024-11-14T06:35:59.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57292024-11-14T06:35:59.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57302024-11-14T06:35:59.594ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57312024-11-14T06:35:59.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57322024-11-14T06:35:59.594ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57332024-11-14T06:35:59.595ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57342024-11-14T06:35:59.596ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57352024-11-14T06:35:59.597ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
57362024-11-14T06:35:59.597ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57372024-11-14T06:35:59.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57382024-11-14T06:35:59.597ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
57392024-11-14T06:35:59.597ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57402024-11-14T06:35:59.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57412024-11-14T06:35:59.599ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
57422024-11-14T06:35:59.599ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57432024-11-14T06:35:59.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57442024-11-14T06:35:59.611ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
57452024-11-14T06:35:59.611ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 36.628592ms iteration = 100 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
57462024-11-14T06:35:59.620ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
57472024-11-14T06:35:59.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
57482024-11-14T06:35:59.622ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 47.334001ms iteration = 34 status = {"errors":[],"records_set_to_done":[]}
57492024-11-14T06:35:59.623ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
57502024-11-14T06:35:59.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
57512024-11-14T06:35:59.625ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57522024-11-14T06:35:59.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57532024-11-14T06:35:59.626ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
57542024-11-14T06:35:59.626ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 52.484987ms iteration = 34 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
57552024-11-14T06:35:59.628ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57562024-11-14T06:35:59.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57572024-11-14T06:35:59.629ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
57582024-11-14T06:35:59.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
57592024-11-14T06:35:59.630ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
57602024-11-14T06:35:59.630ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
57612024-11-14T06:35:59.630ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 56.009052ms iteration = 34 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
57622024-11-14T06:35:59.630ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57632024-11-14T06:35:59.633ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 27a56cb4-44ff-4d5b-931e-1c2c0642844d, lookup_type: ById(27a56cb4-44ff-4d5b-931e-1c2c0642844d) } result = Ok(())
57642024-11-14T06:35:59.633ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57652024-11-14T06:35:59.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57662024-11-14T06:35:59.637ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 62.787659ms iteration = 34 status = 0
57672024-11-14T06:35:59.638ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57682024-11-14T06:35:59.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57692024-11-14T06:35:59.640ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57702024-11-14T06:35:59.642ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
57712024-11-14T06:35:59.642ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57722024-11-14T06:35:59.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57732024-11-14T06:35:59.644ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57742024-11-14T06:35:59.645ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
57752024-11-14T06:35:59.645ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57762024-11-14T06:35:59.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57772024-11-14T06:35:59.659ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 84.067385ms iteration = 34 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
57782024-11-14T06:35:59.660ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
57792024-11-14T06:35:59.660ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
57802024-11-14T06:35:59.660ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e76bccbf-a999-4a02-bc5a-37fea142b694", "content-length": "26", "date": "Thu, 14 Nov 2024 06:35:59 GMT"} })
57812024-11-14T06:35:59.660ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
57822024-11-14T06:35:59.661ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
57832024-11-14T06:35:59.661ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 86.412568ms iteration = 34 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
57842024-11-14T06:35:59.663ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 89.075038ms iteration = 34 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
57852024-11-14T06:35:59.681ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 zone_address = fd00:1122:3344:101::2
57862024-11-14T06:35:59.681ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
57872024-11-14T06:35:59.681ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff955125-83f0-4ec2-b434-1461afabac73", "content-length": "26", "date": "Thu, 14 Nov 2024 06:35:59 GMT"} })
57882024-11-14T06:35:59.681ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
57892024-11-14T06:35:59.683ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
57902024-11-14T06:35:59.683ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
57912024-11-14T06:35:59.683ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c9abb7dc-b995-4f05-9fd9-5faf2c0db898", "content-length": "26", "date": "Thu, 14 Nov 2024 06:35:59 GMT"} })
57922024-11-14T06:35:59.683ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
57932024-11-14T06:35:59.684ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
57942024-11-14T06:35:59.686ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
57952024-11-14T06:35:59.712ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 137.821975ms iteration = 37 status = {"physical_disks_added":0}
57962024-11-14T06:35:59.780ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
57972024-11-14T06:35:59.785ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
57982024-11-14T06:35:59.803ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
57992024-11-14T06:35:59.804ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
58002024-11-14T06:35:59.804ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 230.010271ms iteration = 34 status = {}
58012024-11-14T06:35:59.809ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "79a0515e-b710-4a97-b7de-0e353fb53d1b", "content-length": "372", "date": "Thu, 14 Nov 2024 06:35:59 GMT"} })
58022024-11-14T06:35:59.809ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58032024-11-14T06:35:59.809ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "714eee49-6f34-4ad8-b7e4-4b83dc90efee", "content-length": "691", "date": "Thu, 14 Nov 2024 06:35:59 GMT"} })
58042024-11-14T06:35:59.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58052024-11-14T06:35:59.809ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
58062024-11-14T06:35:59.809ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
58072024-11-14T06:35:59.809ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
58082024-11-14T06:35:59.812ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 237.603003ms iteration = 35 status = {}
58092024-11-14T06:35:59.817ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "41ebcbef-7862-47d0-8870-543a81d7adc6", "content-length": "2", "date": "Thu, 14 Nov 2024 06:35:59 GMT"} })
58102024-11-14T06:35:59.818ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
58112024-11-14T06:35:59.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
58122024-11-14T06:35:59.820ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 246.393396ms iteration = 34 status = null
58132024-11-14T06:35:59.823ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
58142024-11-14T06:35:59.823ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
58152024-11-14T06:35:59.866ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58162024-11-14T06:35:59.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58172024-11-14T06:35:59.869ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: cecfafa4-4697-4aa6-949f-23c34aa9d5bd, rack_id: f391bffc-9f2b-4c87-85cd-2718afa7cb93, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(58c91208-be0a-4936-a7c2-2ae07694e16d) } rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
58182024-11-14T06:35:59.869ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58192024-11-14T06:35:59.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58202024-11-14T06:35:59.879ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
58212024-11-14T06:35:59.880ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "04ba09ca-a5b0-4df3-9694-3476a3938eb7", "content-length": "134", "date": "Thu, 14 Nov 2024 06:35:59 GMT"} })
58222024-11-14T06:35:59.880ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
58232024-11-14T06:35:59.880ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 58c91208-be0a-4936-a7c2-2ae07694e16d
58242024-11-14T06:35:59.880ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
58252024-11-14T06:35:59.880ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
58262024-11-14T06:35:59.880ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
58272024-11-14T06:35:59.880ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
58282024-11-14T06:35:59.880ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
58292024-11-14T06:35:59.880ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
58302024-11-14T06:35:59.880ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
58312024-11-14T06:35:59.880ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
58322024-11-14T06:35:59.881ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
58332024-11-14T06:35:59.881ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58342024-11-14T06:35:59.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58352024-11-14T06:35:59.883ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
58362024-11-14T06:35:59.883ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "8c58738e-be03-4a56-8e5d-d0fcdeae958a", "content-length": "2", "date": "Thu, 14 Nov 2024 06:35:59 GMT"} })
58372024-11-14T06:35:59.883ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
58382024-11-14T06:35:59.883ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "611217a7-c639-4c79-b9ff-07f78cc2275f", "content-length": "52", "date": "Thu, 14 Nov 2024 06:35:59 GMT"} })
58392024-11-14T06:35:59.883ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
58402024-11-14T06:35:59.883ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
58412024-11-14T06:35:59.931ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 69486f31-75aa-4709-8fd6-c8b1c8450ce0 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
58422024-11-14T06:35:59.931ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 69486f31-75aa-4709-8fd6-c8b1c8450ce0 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
58432024-11-14T06:35:59.931ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "8771a703-9c3d-4835-a909-b995dc417599", "date": "Thu, 14 Nov 2024 06:35:59 GMT"} })
58442024-11-14T06:35:59.931ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58452024-11-14T06:35:59.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58462024-11-14T06:35:59.933ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2240 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 69486f31-75aa-4709-8fd6-c8b1c8450ce0 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
58472024-11-14T06:35:59.934ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58482024-11-14T06:35:59.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58492024-11-14T06:35:59.937ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58502024-11-14T06:35:59.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58512024-11-14T06:35:59.940ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
58522024-11-14T06:35:59.940ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
58532024-11-14T06:35:59.944ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "9c630988-c441-40b1-afe3-be2925ed2764", "date": "Thu, 14 Nov 2024 06:35:59 GMT"} })
58542024-11-14T06:35:59.946ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 370.476446ms iteration = 35 status = {}
58552024-11-14T06:36:00.037ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "1a693a7f-aa49-426e-a06c-495006ed155d", "date": "Thu, 14 Nov 2024 06:35:59 GMT"} })
58562024-11-14T06:36:00.037ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch = Switch0
58572024-11-14T06:36:00.037ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
58582024-11-14T06:36:00.037ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "409eec0b-e331-435b-ae58-163031db8767", "content-length": "682", "date": "Thu, 14 Nov 2024 06:35:59 GMT"} })
58592024-11-14T06:36:00.037ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58602024-11-14T06:36:00.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58612024-11-14T06:36:00.041ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58622024-11-14T06:36:00.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58632024-11-14T06:36:00.045ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58642024-11-14T06:36:00.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58652024-11-14T06:36:00.047ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58662024-11-14T06:36:00.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58672024-11-14T06:36:00.055ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 480.829269ms iteration = 34 status = {}
58682024-11-14T06:36:00.957ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 79902649-dddf-4c24-bd27-332bb69e1316 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
58692024-11-14T06:36:00.957ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 79902649-dddf-4c24-bd27-332bb69e1316 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
58702024-11-14T06:36:00.959ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2017 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 79902649-dddf-4c24-bd27-332bb69e1316 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
58712024-11-14T06:36:01.980ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f0fcb536-a75e-4d2b-9e4f-eb8fc3364cbb roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
58722024-11-14T06:36:01.980ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f0fcb536-a75e-4d2b-9e4f-eb8fc3364cbb resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
58732024-11-14T06:36:01.982ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2407 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = f0fcb536-a75e-4d2b-9e4f-eb8fc3364cbb response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
58742024-11-14T06:36:02.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36021 req_id = 4754fd53-8546-4a1c-a82b-e31e3a09f5e6 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/12?limit=100
58752024-11-14T06:36:02.261ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36021 req_id = 4754fd53-8546-4a1c-a82b-e31e3a09f5e6 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/12?limit=100
58762024-11-14T06:36:02.264ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3758 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:36021 req_id = 4754fd53-8546-4a1c-a82b-e31e3a09f5e6 response_code = 200 uri = /nat/ipv4/changeset/12?limit=100
58772024-11-14T06:36:03.005ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 76b3e525-b075-47f4-b4fc-204f9f3f7422 roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
58782024-11-14T06:36:03.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 76b3e525-b075-47f4-b4fc-204f9f3f7422 resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
58792024-11-14T06:36:03.007ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2402 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 76b3e525-b075-47f4-b4fc-204f9f3f7422 response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
58802024-11-14T06:36:04.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 4d982dec-a8d5-4b32-a85d-7c9d9f674cfa roles = RoleSet { roles: {} } uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
58812024-11-14T06:36:04.030ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 4d982dec-a8d5-4b32-a85d-7c9d9f674cfa resource = Database result = Ok(()) uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d
58822024-11-14T06:36:04.031ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2146 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:55795 req_id = 4d982dec-a8d5-4b32-a85d-7c9d9f674cfa response_code = 200 uri = /probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d