Max level shown:
12024-10-24T19:00:00.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = a08c462a-e12b-4239-86e7-40899e39e1e7 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
22024-10-24T19:00:00.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = a08c462a-e12b-4239-86e7-40899e39e1e7 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
32024-10-24T19:00:00.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2403 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = a08c462a-e12b-4239-86e7-40899e39e1e7 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
42024-10-24T19:00:01.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = d2951456-ab71-4827-a7eb-059f42aafeae roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
52024-10-24T19:00:01.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = d2951456-ab71-4827-a7eb-059f42aafeae resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
62024-10-24T19:00:01.378ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2409 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = d2951456-ab71-4827-a7eb-059f42aafeae response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
72024-10-24T19:00:02.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 6647baf9-cd86-40bd-826f-292c3ff51deb roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
82024-10-24T19:00:02.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 6647baf9-cd86-40bd-826f-292c3ff51deb resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
92024-10-24T19:00:02.406ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3461 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 6647baf9-cd86-40bd-826f-292c3ff51deb response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
102024-10-24T19:00:03.428ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 87567a7f-6130-410d-b8e2-12655c2e89e6 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
112024-10-24T19:00:03.429ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 87567a7f-6130-410d-b8e2-12655c2e89e6 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
122024-10-24T19:00:03.431ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2808 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 87567a7f-6130-410d-b8e2-12655c2e89e6 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
132024-10-24T19:00:04.452ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = da17ec7e-b93e-4509-990b-dee2aac9db5a roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
142024-10-24T19:00:04.453ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = da17ec7e-b93e-4509-990b-dee2aac9db5a resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
152024-10-24T19:00:04.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9373 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = da17ec7e-b93e-4509-990b-dee2aac9db5a response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
162024-10-24T19:00:05.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59130 req_id = aaa98d9c-8e52-4a82-8219-ec3394d3a68c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
172024-10-24T19:00:05.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59130 req_id = aaa98d9c-8e52-4a82-8219-ec3394d3a68c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
182024-10-24T19:00:05.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2985 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59130 req_id = aaa98d9c-8e52-4a82-8219-ec3394d3a68c response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
192024-10-24T19:00:05.380ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59130 req_id = 4c0ef960-7e3d-4f31-9358-2bc7e8e87daf roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/9?limit=100
202024-10-24T19:00:05.380ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59130 req_id = 4c0ef960-7e3d-4f31-9358-2bc7e8e87daf resource = Database result = Ok(()) uri = /nat/ipv4/changeset/9?limit=100
212024-10-24T19:00:05.383ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3125 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59130 req_id = 4c0ef960-7e3d-4f31-9358-2bc7e8e87daf response_code = 200 uri = /nat/ipv4/changeset/9?limit=100
222024-10-24T19:00:05.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = ca4dc4b9-6a72-4c02-9ed5-1faf8bd84340 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
232024-10-24T19:00:05.485ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = ca4dc4b9-6a72-4c02-9ed5-1faf8bd84340 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
242024-10-24T19:00:05.487ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2292 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = ca4dc4b9-6a72-4c02-9ed5-1faf8bd84340 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
252024-10-24T19:00:06.511ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 0503a5de-0add-4450-8c76-4ef5f9280c1e roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
262024-10-24T19:00:06.511ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 0503a5de-0add-4450-8c76-4ef5f9280c1e resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
272024-10-24T19:00:06.513ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2702 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 0503a5de-0add-4450-8c76-4ef5f9280c1e response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
282024-10-24T19:00:07.533ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = dc3091bd-f2ef-4a8e-9870-39e0484328d6 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
292024-10-24T19:00:07.534ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = dc3091bd-f2ef-4a8e-9870-39e0484328d6 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
302024-10-24T19:00:07.536ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3125 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = dc3091bd-f2ef-4a8e-9870-39e0484328d6 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
312024-10-24T19:00:08.532ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
322024-10-24T19:00:08.532ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
332024-10-24T19:00:08.532ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
342024-10-24T19:00:08.532ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
352024-10-24T19:00:08.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
362024-10-24T19:00:08.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
372024-10-24T19:00:08.535ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
382024-10-24T19:00:08.537ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
392024-10-24T19:00:08.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
402024-10-24T19:00:08.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
412024-10-24T19:00:08.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
422024-10-24T19:00:08.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
432024-10-24T19:00:08.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
442024-10-24T19:00:08.546ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: fbb59198-7d6e-40d8-9b05-3fd3707f9c53, lookup_type: ById(fbb59198-7d6e-40d8-9b05-3fd3707f9c53) } result = Ok(())
452024-10-24T19:00:08.546ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
462024-10-24T19:00:08.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
472024-10-24T19:00:08.557ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = fbb59198-7d6e-40d8-9b05-3fd3707f9c53 original_time_created = 2024-10-24 18:54:46.689131 UTC target_id = fbb59198-7d6e-40d8-9b05-3fd3707f9c53 time_created = 2024-10-24 18:54:46.689131 UTC
482024-10-24T19:00:08.557ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.217243ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"fbb59198-7d6e-40d8-9b05-3fd3707f9c53","time_created":"2024-10-24T18:54:46.689131Z"}
492024-10-24T19:00:08.566ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 3dd72a89-f83b-4e8d-a26d-7e18f8b804ef roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
502024-10-24T19:00:08.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 3dd72a89-f83b-4e8d-a26d-7e18f8b804ef resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
512024-10-24T19:00:08.568ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2238 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 3dd72a89-f83b-4e8d-a26d-7e18f8b804ef response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
522024-10-24T19:00:08.568ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
532024-10-24T19:00:08.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
542024-10-24T19:00:08.596ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.394438ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
552024-10-24T19:00:09.331ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 495 local_addr = [fd00:1122:3344:101::b]:60338 method = GET remote_addr = [fd00:1122:3344:101::d]:39079 req_id = 476e949b-6788-480a-bea8-c04b85b3ec2d response_code = 200 uri = /51c1446e-49e7-4598-8832-f33ccdf3c076
562024-10-24T19:00:09.591ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = bae8f262-6b0e-4a26-a81b-4de2b35563aa roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
572024-10-24T19:00:09.591ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = bae8f262-6b0e-4a26-a81b-4de2b35563aa resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
582024-10-24T19:00:09.594ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2754 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = bae8f262-6b0e-4a26-a81b-4de2b35563aa response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
592024-10-24T19:00:10.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 21679fd9-abd9-4db1-9846-3594e590897d roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
602024-10-24T19:00:10.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 21679fd9-abd9-4db1-9846-3594e590897d resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
612024-10-24T19:00:10.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1959 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 21679fd9-abd9-4db1-9846-3594e590897d response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
622024-10-24T19:00:11.637ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 46dcefa7-e61a-404e-82fd-1cbcd6fb05a5 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
632024-10-24T19:00:11.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 46dcefa7-e61a-404e-82fd-1cbcd6fb05a5 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
642024-10-24T19:00:11.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2401 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 46dcefa7-e61a-404e-82fd-1cbcd6fb05a5 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
652024-10-24T19:00:12.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 8f1ac42f-0373-4351-831d-660e0380b407 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
662024-10-24T19:00:12.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 8f1ac42f-0373-4351-831d-660e0380b407 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
672024-10-24T19:00:12.663ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2461 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 8f1ac42f-0373-4351-831d-660e0380b407 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
682024-10-24T19:00:12.710ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = c85c899f-ce35-4683-8b9b-bf19ff626756 remote_addr = [fd00:1122:3344:101::1]:34923 req_id = e57f0c55-0d17-4414-aaa6-0153ee3f438a uri = /vmms/c85c899f-ce35-4683-8b9b-bf19ff626756 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-10-24T19:00:12.691494605Z }
692024-10-24T19:00:12.710ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34923 req_id = e57f0c55-0d17-4414-aaa6-0153ee3f438a roles = RoleSet { roles: {} } uri = /vmms/c85c899f-ce35-4683-8b9b-bf19ff626756
702024-10-24T19:00:12.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34923 req_id = e57f0c55-0d17-4414-aaa6-0153ee3f438a resource = Database result = Ok(()) uri = /vmms/c85c899f-ce35-4683-8b9b-bf19ff626756
712024-10-24T19:00:12.734ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 42934 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34923 req_id = e57f0c55-0d17-4414-aaa6-0153ee3f438a response_code = 204 uri = /vmms/c85c899f-ce35-4683-8b9b-bf19ff626756
722024-10-24T19:00:12.735ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = c85c899f-ce35-4683-8b9b-bf19ff626756 remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 51982c5b-6382-44fd-990e-ab5e99659803 uri = /vmms/c85c899f-ce35-4683-8b9b-bf19ff626756 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-10-24T19:00:12.735097767Z }
732024-10-24T19:00:12.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 51982c5b-6382-44fd-990e-ab5e99659803 roles = RoleSet { roles: {} } uri = /vmms/c85c899f-ce35-4683-8b9b-bf19ff626756
742024-10-24T19:00:12.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 51982c5b-6382-44fd-990e-ab5e99659803 resource = Database result = Ok(()) uri = /vmms/c85c899f-ce35-4683-8b9b-bf19ff626756
752024-10-24T19:00:12.744ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9243 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 51982c5b-6382-44fd-990e-ab5e99659803 response_code = 204 uri = /vmms/c85c899f-ce35-4683-8b9b-bf19ff626756
762024-10-24T19:00:13.684ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 99fd9c47-6a9a-44d6-a6ef-faf4b526ddec roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
772024-10-24T19:00:13.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 99fd9c47-6a9a-44d6-a6ef-faf4b526ddec resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
782024-10-24T19:00:13.687ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2567 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 99fd9c47-6a9a-44d6-a6ef-faf4b526ddec response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
792024-10-24T19:00:14.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = d7d1a9b7-d650-4181-ae7a-b841152a0a7f roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
802024-10-24T19:00:14.708ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = d7d1a9b7-d650-4181-ae7a-b841152a0a7f resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
812024-10-24T19:00:14.710ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2140 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = d7d1a9b7-d650-4181-ae7a-b841152a0a7f response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
822024-10-24T19:00:15.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 119d3ed8-d64a-4974-a6e6-515795959b03 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
832024-10-24T19:00:15.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 119d3ed8-d64a-4974-a6e6-515795959b03 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
842024-10-24T19:00:15.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2311 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 119d3ed8-d64a-4974-a6e6-515795959b03 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
852024-10-24T19:00:16.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 645455f2-c53d-421b-8af4-0b196c5704ec roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
862024-10-24T19:00:16.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 645455f2-c53d-421b-8af4-0b196c5704ec resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
872024-10-24T19:00:16.756ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2262 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 645455f2-c53d-421b-8af4-0b196c5704ec response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
882024-10-24T19:00:17.778ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = d378110f-c084-4c0d-8883-760356133867 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
892024-10-24T19:00:17.778ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = d378110f-c084-4c0d-8883-760356133867 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
902024-10-24T19:00:17.780ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2483 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = d378110f-c084-4c0d-8883-760356133867 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
912024-10-24T19:00:18.533ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
922024-10-24T19:00:18.533ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
932024-10-24T19:00:18.533ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
942024-10-24T19:00:18.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
952024-10-24T19:00:18.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
962024-10-24T19:00:18.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
972024-10-24T19:00:18.535ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
982024-10-24T19:00:18.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
992024-10-24T19:00:18.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1002024-10-24T19:00:18.538ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
1012024-10-24T19:00:18.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1022024-10-24T19:00:18.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1032024-10-24T19:00:18.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1042024-10-24T19:00:18.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1052024-10-24T19:00:18.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1062024-10-24T19:00:18.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: fbb59198-7d6e-40d8-9b05-3fd3707f9c53, lookup_type: ById(fbb59198-7d6e-40d8-9b05-3fd3707f9c53) } result = Ok(())
1072024-10-24T19:00:18.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1082024-10-24T19:00:18.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1092024-10-24T19:00:18.553ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = fbb59198-7d6e-40d8-9b05-3fd3707f9c53 original_time_created = 2024-10-24 18:54:46.689131 UTC target_id = fbb59198-7d6e-40d8-9b05-3fd3707f9c53 time_created = 2024-10-24 18:54:46.689131 UTC
1102024-10-24T19:00:18.553ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.353844ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"fbb59198-7d6e-40d8-9b05-3fd3707f9c53","time_created":"2024-10-24T18:54:46.689131Z"}
1112024-10-24T19:00:18.564ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.599157ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
1122024-10-24T19:00:18.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 31ece7f0-63c7-47d7-af93-0e89294adf20 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
1132024-10-24T19:00:18.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 31ece7f0-63c7-47d7-af93-0e89294adf20 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
1142024-10-24T19:00:18.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2154 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 31ece7f0-63c7-47d7-af93-0e89294adf20 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
1152024-10-24T19:00:19.331ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 833 local_addr = [fd00:1122:3344:101::b]:60338 method = GET remote_addr = [fd00:1122:3344:101::d]:39079 req_id = 2d96c7ed-20c4-4749-9631-45a8f52181f1 response_code = 200 uri = /51c1446e-49e7-4598-8832-f33ccdf3c076
1162024-10-24T19:00:19.822ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = c29f6ffe-2075-4bef-bbd8-554cf70a9e80 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
1172024-10-24T19:00:19.823ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = c29f6ffe-2075-4bef-bbd8-554cf70a9e80 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
1182024-10-24T19:00:19.825ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2155 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = c29f6ffe-2075-4bef-bbd8-554cf70a9e80 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
1192024-10-24T19:00:20.844ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 57e2306e-eaff-44eb-82a7-80b1ec660fe3 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
1202024-10-24T19:00:20.845ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 57e2306e-eaff-44eb-82a7-80b1ec660fe3 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
1212024-10-24T19:00:20.846ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2037 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 57e2306e-eaff-44eb-82a7-80b1ec660fe3 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
1222024-10-24T19:00:21.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = a76bef54-0d5e-492c-b949-0d66f990ba38 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
1232024-10-24T19:00:21.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = a76bef54-0d5e-492c-b949-0d66f990ba38 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
1242024-10-24T19:00:21.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2333 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = a76bef54-0d5e-492c-b949-0d66f990ba38 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
1252024-10-24T19:00:22.829ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = c85c899f-ce35-4683-8b9b-bf19ff626756 remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 7451626d-54d7-4321-9225-902a452d33b6 uri = /vmms/c85c899f-ce35-4683-8b9b-bf19ff626756 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-10-24T19:00:22.829010300Z }
1262024-10-24T19:00:22.829ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 7451626d-54d7-4321-9225-902a452d33b6 roles = RoleSet { roles: {} } uri = /vmms/c85c899f-ce35-4683-8b9b-bf19ff626756
1272024-10-24T19:00:22.829ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 7451626d-54d7-4321-9225-902a452d33b6 resource = Database result = Ok(()) uri = /vmms/c85c899f-ce35-4683-8b9b-bf19ff626756
1282024-10-24T19:00:22.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 36708 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 7451626d-54d7-4321-9225-902a452d33b6 response_code = 204 uri = /vmms/c85c899f-ce35-4683-8b9b-bf19ff626756
1292024-10-24T19:00:22.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = f637dc3b-71ee-40d7-9f0f-bea072c8fea7 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
1302024-10-24T19:00:22.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = f637dc3b-71ee-40d7-9f0f-bea072c8fea7 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
1312024-10-24T19:00:22.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1950 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = f637dc3b-71ee-40d7-9f0f-bea072c8fea7 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
1322024-10-24T19:00:23.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59130 req_id = 978e99fd-c2d6-44e9-8ed3-db2c6a735271 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/9?limit=100
1332024-10-24T19:00:23.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59130 req_id = 978e99fd-c2d6-44e9-8ed3-db2c6a735271 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/9?limit=100
1342024-10-24T19:00:23.406ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2640 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59130 req_id = 978e99fd-c2d6-44e9-8ed3-db2c6a735271 response_code = 200 uri = /nat/ipv4/changeset/9?limit=100
1352024-10-24T19:00:23.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59130 req_id = 64993628-781c-41b6-ac45-71732dbfa96b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
1362024-10-24T19:00:23.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59130 req_id = 64993628-781c-41b6-ac45-71732dbfa96b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
1372024-10-24T19:00:23.409ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3155 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59130 req_id = 64993628-781c-41b6-ac45-71732dbfa96b response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
1382024-10-24T19:00:23.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = b564cf7d-da3f-412b-8e54-8a125b34801f roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
1392024-10-24T19:00:23.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = b564cf7d-da3f-412b-8e54-8a125b34801f resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
1402024-10-24T19:00:23.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2416 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = b564cf7d-da3f-412b-8e54-8a125b34801f response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
1412024-10-24T19:00:24.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59130 req_id = 25b00102-acc3-489e-886d-4e35ba72002b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
1422024-10-24T19:00:24.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59130 req_id = 25b00102-acc3-489e-886d-4e35ba72002b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
1432024-10-24T19:00:24.414ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3253 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59130 req_id = 25b00102-acc3-489e-886d-4e35ba72002b response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
1442024-10-24T19:00:24.934ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 0f6a4dbc-8bed-4448-8797-342d86f6f949 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
1452024-10-24T19:00:24.935ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 0f6a4dbc-8bed-4448-8797-342d86f6f949 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
1462024-10-24T19:00:24.937ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2326 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 0f6a4dbc-8bed-4448-8797-342d86f6f949 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
1472024-10-24T19:00:25.283ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = c85c899f-ce35-4683-8b9b-bf19ff626756 remote_addr = [fd00:1122:3344:101::1]:34923 req_id = cf0def38-55e7-4220-8960-4464d90f4b88 uri = /vmms/c85c899f-ce35-4683-8b9b-bf19ff626756 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-10-24T19:00:25.283394424Z }
1482024-10-24T19:00:25.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34923 req_id = cf0def38-55e7-4220-8960-4464d90f4b88 roles = RoleSet { roles: {} } uri = /vmms/c85c899f-ce35-4683-8b9b-bf19ff626756
1492024-10-24T19:00:25.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34923 req_id = cf0def38-55e7-4220-8960-4464d90f4b88 resource = Database result = Ok(()) uri = /vmms/c85c899f-ce35-4683-8b9b-bf19ff626756
1502024-10-24T19:00:25.294ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = c85c899f-ce35-4683-8b9b-bf19ff626756 remote_addr = [fd00:1122:3344:101::1]:34923 req_id = cf0def38-55e7-4220-8960-4464d90f4b88 uri = /vmms/c85c899f-ce35-4683-8b9b-bf19ff626756 vmm_needs_update = true
1512024-10-24T19:00:25.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34923 req_id = cf0def38-55e7-4220-8960-4464d90f4b88 roles = RoleSet { roles: {} } uri = /vmms/c85c899f-ce35-4683-8b9b-bf19ff626756
1522024-10-24T19:00:25.298ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34923 req_id = cf0def38-55e7-4220-8960-4464d90f4b88 resource = Database result = Ok(()) uri = /vmms/c85c899f-ce35-4683-8b9b-bf19ff626756
1532024-10-24T19:00:25.301ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34923 req_id = cf0def38-55e7-4220-8960-4464d90f4b88 roles = RoleSet { roles: {} } uri = /vmms/c85c899f-ce35-4683-8b9b-bf19ff626756
1542024-10-24T19:00:25.301ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34923 req_id = cf0def38-55e7-4220-8960-4464d90f4b88 resource = Database result = Ok(()) uri = /vmms/c85c899f-ce35-4683-8b9b-bf19ff626756
1552024-10-24T19:00:25.303ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34923 req_id = cf0def38-55e7-4220-8960-4464d90f4b88 roles = RoleSet { roles: {} } uri = /vmms/c85c899f-ce35-4683-8b9b-bf19ff626756
1562024-10-24T19:00:25.303ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34923 req_id = cf0def38-55e7-4220-8960-4464d90f4b88 resource = Database result = Ok(()) uri = /vmms/c85c899f-ce35-4683-8b9b-bf19ff626756
1572024-10-24T19:00:25.307ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34923 req_id = cf0def38-55e7-4220-8960-4464d90f4b88 roles = RoleSet { roles: {} } uri = /vmms/c85c899f-ce35-4683-8b9b-bf19ff626756
1582024-10-24T19:00:25.308ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34923 req_id = cf0def38-55e7-4220-8960-4464d90f4b88 resource = Database result = Ok(()) uri = /vmms/c85c899f-ce35-4683-8b9b-bf19ff626756
1592024-10-24T19:00:25.309ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34923 req_id = cf0def38-55e7-4220-8960-4464d90f4b88 roles = RoleSet { roles: {} } uri = /vmms/c85c899f-ce35-4683-8b9b-bf19ff626756
1602024-10-24T19:00:25.309ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34923 req_id = cf0def38-55e7-4220-8960-4464d90f4b88 resource = Database result = Ok(()) uri = /vmms/c85c899f-ce35-4683-8b9b-bf19ff626756
1612024-10-24T19:00:25.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34923 req_id = cf0def38-55e7-4220-8960-4464d90f4b88 roles = RoleSet { roles: {} } uri = /vmms/c85c899f-ce35-4683-8b9b-bf19ff626756
1622024-10-24T19:00:25.311ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34923 req_id = cf0def38-55e7-4220-8960-4464d90f4b88 resource = Database result = Ok(()) uri = /vmms/c85c899f-ce35-4683-8b9b-bf19ff626756
1632024-10-24T19:00:25.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34923 req_id = cf0def38-55e7-4220-8960-4464d90f4b88 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/c85c899f-ce35-4683-8b9b-bf19ff626756
1642024-10-24T19:00:25.317ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34923 req_id = cf0def38-55e7-4220-8960-4464d90f4b88 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 68627db6-53a8-4390-a3e6-e94f65d72ce7, lookup_type: ById(68627db6-53a8-4390-a3e6-e94f65d72ce7) }, key: 76e3412a-829f-45e7-a8cf-d891529a31cf, lookup_type: ById(76e3412a-829f-45e7-a8cf-d891529a31cf) }, key: 4adb4920-442e-4d65-bb79-cc0009bb1b22, lookup_type: ById(4adb4920-442e-4d65-bb79-cc0009bb1b22) } result = Ok(()) uri = /vmms/c85c899f-ce35-4683-8b9b-bf19ff626756
1652024-10-24T19:00:25.325ZINFOnexus (dropshot_internal): starting update saga for 4adb4920-442e-4d65-bb79-cc0009bb1b22 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1618 instance_id = 4adb4920-442e-4d65-bb79-cc0009bb1b22 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:34923 req_id = cf0def38-55e7-4220-8960-4464d90f4b88 uri = /vmms/c85c899f-ce35-4683-8b9b-bf19ff626756 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-10-24T19:00:25.283394424Z }
1662024-10-24T19:00:25.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 42378 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34923 req_id = cf0def38-55e7-4220-8960-4464d90f4b88 response_code = 204 uri = /vmms/c85c899f-ce35-4683-8b9b-bf19ff626756
1672024-10-24T19:00:25.326ZDEBGnexus (dropshot_internal): preparing instance-update saga for 4adb4920-442e-4d65-bb79-cc0009bb1b22... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 4adb4920-442e-4d65-bb79-cc0009bb1b22 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34923 req_id = cf0def38-55e7-4220-8960-4464d90f4b88 uri = /vmms/c85c899f-ce35-4683-8b9b-bf19ff626756
1682024-10-24T19:00:25.326ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 209286e0-a004-4506-867d-92b22cab4cf5 saga_name = start-instance-update
1692024-10-24T19:00:25.326ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"4adb4920-442e-4d65-bb79-cc0009bb1b22","lookup_type":{"ById":"4adb4920-442e-4d65-bb79-cc0009bb1b22"},"parent":{"key":"76e3412a-829f-45e7-a8cf-d891529a31cf","lookup_type":{"ById":"76e3412a-829f-45e7-a8cf-d891529a31cf"},"parent":{"key":"68627db6-53a8-4390-a3e6-e94f65d72ce7","lookup_type":{"ById":"68627db6-53a8-4390-a3e6-e94f65d72ce7"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 209286e0-a004-4506-867d-92b22cab4cf5 saga_name = start-instance-update sec_id = 51c1446e-49e7-4598-8832-f33ccdf3c076
1702024-10-24T19:00:25.326ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 209286e0-a004-4506-867d-92b22cab4cf5 saga_name = start-instance-update
1712024-10-24T19:00:25.326ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = c85c899f-ce35-4683-8b9b-bf19ff626756 remote_addr = [fd00:1122:3344:101::1]:34923 req_id = c5eb647f-3585-48d9-af91-e4b47bc93684 uri = /vmms/c85c899f-ce35-4683-8b9b-bf19ff626756 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-10-24T19:00:25.283394424Z }
1722024-10-24T19:00:25.326ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34923 req_id = c5eb647f-3585-48d9-af91-e4b47bc93684 roles = RoleSet { roles: {} } uri = /vmms/c85c899f-ce35-4683-8b9b-bf19ff626756
1732024-10-24T19:00:25.326ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34923 req_id = c5eb647f-3585-48d9-af91-e4b47bc93684 resource = Database result = Ok(()) uri = /vmms/c85c899f-ce35-4683-8b9b-bf19ff626756
1742024-10-24T19:00:25.332ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 5719 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:34923 req_id = c5eb647f-3585-48d9-af91-e4b47bc93684 response_code = 204 uri = /vmms/c85c899f-ce35-4683-8b9b-bf19ff626756
1752024-10-24T19:00:25.368ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 209286e0-a004-4506-867d-92b22cab4cf5 saga_name = start-instance-update
1762024-10-24T19:00:25.368ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 209286e0-a004-4506-867d-92b22cab4cf5 saga_name = start-instance-update sec_id = 51c1446e-49e7-4598-8832-f33ccdf3c076
1772024-10-24T19:00:25.368ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 51c1446e-49e7-4598-8832-f33ccdf3c076
1782024-10-24T19:00:25.368ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 209286e0-a004-4506-867d-92b22cab4cf5
1792024-10-24T19:00:25.375ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 51c1446e-49e7-4598-8832-f33ccdf3c076
1802024-10-24T19:00:25.375ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 209286e0-a004-4506-867d-92b22cab4cf5
1812024-10-24T19:00:25.378ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 51c1446e-49e7-4598-8832-f33ccdf3c076
1822024-10-24T19:00:25.378ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 209286e0-a004-4506-867d-92b22cab4cf5
1832024-10-24T19:00:25.382ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 51c1446e-49e7-4598-8832-f33ccdf3c076
1842024-10-24T19:00:25.382ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("b999d92a-d5d2-458a-9da7-b78eb291a0e4")) node_id = 0 saga_id = 209286e0-a004-4506-867d-92b22cab4cf5
1852024-10-24T19:00:25.385ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 51c1446e-49e7-4598-8832-f33ccdf3c076
1862024-10-24T19:00:25.385ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 209286e0-a004-4506-867d-92b22cab4cf5
1872024-10-24T19:00:25.398ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = 4adb4920-442e-4d65-bb79-cc0009bb1b22 saga_id = 209286e0-a004-4506-867d-92b22cab4cf5 saga_name = start-instance-update
1882024-10-24T19:00:25.400ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 209286e0-a004-4506-867d-92b22cab4cf5 saga_name = start-instance-update saga_node = LockInstance
1892024-10-24T19:00:25.401ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 209286e0-a004-4506-867d-92b22cab4cf5 saga_name = start-instance-update saga_node = LockInstance
1902024-10-24T19:00:25.403ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 209286e0-a004-4506-867d-92b22cab4cf5 saga_name = start-instance-update saga_node = LockInstance
1912024-10-24T19:00:25.403ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 209286e0-a004-4506-867d-92b22cab4cf5 saga_name = start-instance-update saga_node = LockInstance
1922024-10-24T19:00:25.405ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 209286e0-a004-4506-867d-92b22cab4cf5 saga_name = start-instance-update saga_node = LockInstance
1932024-10-24T19:00:25.405ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 209286e0-a004-4506-867d-92b22cab4cf5 saga_name = start-instance-update saga_node = LockInstance
1942024-10-24T19:00:25.406ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 209286e0-a004-4506-867d-92b22cab4cf5 saga_name = start-instance-update saga_node = LockInstance
1952024-10-24T19:00:25.407ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 209286e0-a004-4506-867d-92b22cab4cf5 saga_name = start-instance-update saga_node = LockInstance
1962024-10-24T19:00:25.408ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 209286e0-a004-4506-867d-92b22cab4cf5 saga_name = start-instance-update saga_node = LockInstance
1972024-10-24T19:00:25.408ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 209286e0-a004-4506-867d-92b22cab4cf5 saga_name = start-instance-update saga_node = LockInstance
1982024-10-24T19:00:25.410ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 209286e0-a004-4506-867d-92b22cab4cf5 saga_name = start-instance-update saga_node = LockInstance
1992024-10-24T19:00:25.410ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 209286e0-a004-4506-867d-92b22cab4cf5 saga_name = start-instance-update saga_node = LockInstance
2002024-10-24T19:00:25.411ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 209286e0-a004-4506-867d-92b22cab4cf5 saga_name = start-instance-update saga_node = LockInstance
2012024-10-24T19:00:25.414ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 68627db6-53a8-4390-a3e6-e94f65d72ce7, lookup_type: ById(68627db6-53a8-4390-a3e6-e94f65d72ce7) }, key: 76e3412a-829f-45e7-a8cf-d891529a31cf, lookup_type: ById(76e3412a-829f-45e7-a8cf-d891529a31cf) }, key: 4adb4920-442e-4d65-bb79-cc0009bb1b22, lookup_type: ById(4adb4920-442e-4d65-bb79-cc0009bb1b22) } result = Ok(()) saga_id = 209286e0-a004-4506-867d-92b22cab4cf5 saga_name = start-instance-update saga_node = LockInstance
2022024-10-24T19:00:25.414ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 4adb4920-442e-4d65-bb79-cc0009bb1b22 saga_id = 209286e0-a004-4506-867d-92b22cab4cf5 saga_name = start-instance-update saga_node = LockInstance updater_id = b999d92a-d5d2-458a-9da7-b78eb291a0e4
2032024-10-24T19:00:25.414ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 209286e0-a004-4506-867d-92b22cab4cf5 saga_name = start-instance-update saga_node = LockInstance
2042024-10-24T19:00:25.414ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 209286e0-a004-4506-867d-92b22cab4cf5 saga_name = start-instance-update saga_node = LockInstance
2052024-10-24T19:00:25.429ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 4adb4920-442e-4d65-bb79-cc0009bb1b22 saga_id = 209286e0-a004-4506-867d-92b22cab4cf5 saga_name = start-instance-update saga_node = LockInstance updater_id = b999d92a-d5d2-458a-9da7-b78eb291a0e4
2062024-10-24T19:00:25.429ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 209286e0-a004-4506-867d-92b22cab4cf5 saga_name = start-instance-update saga_node = LockInstance
2072024-10-24T19:00:25.430ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 209286e0-a004-4506-867d-92b22cab4cf5 saga_name = start-instance-update saga_node = LockInstance
2082024-10-24T19:00:25.439ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = 4adb4920-442e-4d65-bb79-cc0009bb1b22 locked_gen = Generation(Generation(2)) saga_id = 209286e0-a004-4506-867d-92b22cab4cf5 saga_name = start-instance-update saga_node = LockInstance updater_id = b999d92a-d5d2-458a-9da7-b78eb291a0e4
2092024-10-24T19:00:25.439ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 51c1446e-49e7-4598-8832-f33ccdf3c076
2102024-10-24T19:00:25.439ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("b999d92a-d5d2-458a-9da7-b78eb291a0e4")}) node_id = 1 saga_id = 209286e0-a004-4506-867d-92b22cab4cf5
2112024-10-24T19:00:25.442ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 51c1446e-49e7-4598-8832-f33ccdf3c076
2122024-10-24T19:00:25.442ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 209286e0-a004-4506-867d-92b22cab4cf5
2132024-10-24T19:00:25.450ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 209286e0-a004-4506-867d-92b22cab4cf5 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
2142024-10-24T19:00:25.450ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 209286e0-a004-4506-867d-92b22cab4cf5 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
2152024-10-24T19:00:25.451ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 209286e0-a004-4506-867d-92b22cab4cf5 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
2162024-10-24T19:00:25.451ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 209286e0-a004-4506-867d-92b22cab4cf5 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
2172024-10-24T19:00:25.452ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 209286e0-a004-4506-867d-92b22cab4cf5 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
2182024-10-24T19:00:25.452ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 209286e0-a004-4506-867d-92b22cab4cf5 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
2192024-10-24T19:00:25.454ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 209286e0-a004-4506-867d-92b22cab4cf5 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
2202024-10-24T19:00:25.457ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 68627db6-53a8-4390-a3e6-e94f65d72ce7, lookup_type: ById(68627db6-53a8-4390-a3e6-e94f65d72ce7) }, key: 76e3412a-829f-45e7-a8cf-d891529a31cf, lookup_type: ById(76e3412a-829f-45e7-a8cf-d891529a31cf) }, key: 4adb4920-442e-4d65-bb79-cc0009bb1b22, lookup_type: ById(4adb4920-442e-4d65-bb79-cc0009bb1b22) } result = Ok(()) saga_id = 209286e0-a004-4506-867d-92b22cab4cf5 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
2212024-10-24T19:00:25.457ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 209286e0-a004-4506-867d-92b22cab4cf5 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
2222024-10-24T19:00:25.457ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 209286e0-a004-4506-867d-92b22cab4cf5 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
2232024-10-24T19:00:25.468ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: c85c899f-ce35-4683-8b9b-bf19ff626756, time_created: 2024-10-24T19:00:04.574433Z, time_deleted: None, instance_id: 4adb4920-442e-4d65-bb79-cc0009bb1b22, sled_id: 8ed5384f-0099-459e-a18a-fdd93abd3452, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-10-24T19:00:25.283394Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-10-24T19:00:01.793930Z, gen: Generation(Generation(3)), propolis_id: Some(c85c899f-ce35-4683-8b9b-bf19ff626756), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = 4adb4920-442e-4d65-bb79-cc0009bb1b22 saga_id = 209286e0-a004-4506-867d-92b22cab4cf5 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(c85c899f-ce35-4683-8b9b-bf19ff626756 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-10-24T19:00:25.466408265Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
2242024-10-24T19:00:25.468ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0 saga_name = instance-update
2252024-10-24T19:00:25.468ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"4adb4920-442e-4d65-bb79-cc0009bb1b22","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"c85c899f-ce35-4683-8b9b-bf19ff626756"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"4adb4920-442e-4d65-bb79-cc0009bb1b22","lookup_type":{"ById":"4adb4920-442e-4d65-bb79-cc0009bb1b22"},"parent":{"key":"76e3412a-829f-45e7-a8cf-d891529a31cf","lookup_type":{"ById":"76e3412a-829f-45e7-a8cf-d891529a31cf"},"parent":{"key":"68627db6-53a8-4390-a3e6-e94f65d72ce7","lookup_type":{"ById":"68627db6-53a8-4390-a3e6-e94f65d72ce7"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"b999d92a-d5d2-458a-9da7-b78eb291a0e4"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"76e3412a-829f-45e7-a8cf-d891529a31cf","ram_diff":1073741824},"destroy_active_vmm":"c85c899f-ce35-4683-8b9b-bf19ff626756","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2024-10-24T19:00:25.466408265Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0 saga_name = instance-update sec_id = 51c1446e-49e7-4598-8832-f33ccdf3c076
2262024-10-24T19:00:25.468ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0 saga_name = instance-update
2272024-10-24T19:00:25.472ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0 saga_name = instance-update
2282024-10-24T19:00:25.472ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0 saga_name = instance-update sec_id = 51c1446e-49e7-4598-8832-f33ccdf3c076
2292024-10-24T19:00:25.472ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 51c1446e-49e7-4598-8832-f33ccdf3c076
2302024-10-24T19:00:25.472ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0
2312024-10-24T19:00:25.476ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 51c1446e-49e7-4598-8832-f33ccdf3c076
2322024-10-24T19:00:25.476ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0
2332024-10-24T19:00:25.479ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 51c1446e-49e7-4598-8832-f33ccdf3c076
2342024-10-24T19:00:25.479ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0
2352024-10-24T19:00:25.482ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 51c1446e-49e7-4598-8832-f33ccdf3c076
2362024-10-24T19:00:25.482ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("cb0b3e4a-3ef3-434a-8e98-40032dad08a7")) node_id = 0 saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0
2372024-10-24T19:00:25.485ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 51c1446e-49e7-4598-8832-f33ccdf3c076
2382024-10-24T19:00:25.485ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0
2392024-10-24T19:00:25.495ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = 4adb4920-442e-4d65-bb79-cc0009bb1b22 parent_lock = UpdaterLock { updater_id: b999d92a-d5d2-458a-9da7-b78eb291a0e4, locked_gen: Generation(Generation(2)) } saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0 saga_name = instance-update
2402024-10-24T19:00:25.495ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0 saga_name = instance-update saga_node = BecomeUpdater
2412024-10-24T19:00:25.495ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0 saga_name = instance-update saga_node = BecomeUpdater
2422024-10-24T19:00:25.504ZDEBGnexus (SagaExecutor): inherited lock from b999d92a-d5d2-458a-9da7-b78eb291a0e4 to cb0b3e4a-3ef3-434a-8e98-40032dad08a7 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 4adb4920-442e-4d65-bb79-cc0009bb1b22 locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = b999d92a-d5d2-458a-9da7-b78eb291a0e4 saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0 saga_name = instance-update saga_node = BecomeUpdater updater_id = cb0b3e4a-3ef3-434a-8e98-40032dad08a7
2432024-10-24T19:00:25.504ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = 4adb4920-442e-4d65-bb79-cc0009bb1b22 saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0 saga_name = instance-update
2442024-10-24T19:00:25.504ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 51c1446e-49e7-4598-8832-f33ccdf3c076
2452024-10-24T19:00:25.504ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("cb0b3e4a-3ef3-434a-8e98-40032dad08a7")}) node_id = 1 saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0
2462024-10-24T19:00:25.508ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 51c1446e-49e7-4598-8832-f33ccdf3c076
2472024-10-24T19:00:25.508ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0
2482024-10-24T19:00:25.511ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 51c1446e-49e7-4598-8832-f33ccdf3c076
2492024-10-24T19:00:25.511ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0
2502024-10-24T19:00:25.513ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 51c1446e-49e7-4598-8832-f33ccdf3c076
2512024-10-24T19:00:25.513ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0
2522024-10-24T19:00:25.517ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = 4adb4920-442e-4d65-bb79-cc0009bb1b22 saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0 saga_name = instance-update
2532024-10-24T19:00:25.519ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 4adb4920-442e-4d65-bb79-cc0009bb1b22
2542024-10-24T19:00:25.521ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0 saga_name = instance-update saga_node = UpdateNetworkConfig
2552024-10-24T19:00:25.522ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0 saga_name = instance-update saga_node = UpdateNetworkConfig
2562024-10-24T19:00:25.526ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0 saga_name = instance-update saga_node = UpdateNetworkConfig
2572024-10-24T19:00:25.526ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0 saga_name = instance-update saga_node = UpdateNetworkConfig
2582024-10-24T19:00:25.528ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
2592024-10-24T19:00:25.528ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0 saga_name = instance-update saga_node = UpdateNetworkConfig
2602024-10-24T19:00:25.528ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0 saga_name = instance-update saga_node = UpdateNetworkConfig
2612024-10-24T19:00:25.530ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
2622024-10-24T19:00:25.530ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
2632024-10-24T19:00:25.531ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
2642024-10-24T19:00:25.532ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
2652024-10-24T19:00:25.533ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
2662024-10-24T19:00:25.533ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
2672024-10-24T19:00:25.533ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
2682024-10-24T19:00:25.544ZDEBGnexus: notifying dendrite of updates instance_id = Some(4adb4920-442e-4d65-bb79-cc0009bb1b22 (instance)) switch = switch0
2692024-10-24T19:00:25.545ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8ed5384f-0099-459e-a18a-fdd93abd3452.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8ed5384f-0099-459e-a18a-fdd93abd3452.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3268, tv_nsec: 910413935 } })
2702024-10-24T19:00:25.545ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1105
2712024-10-24T19:00:25.576ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1113 zone_address = fd00:1122:3344:101::2
2722024-10-24T19:00:25.576ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2732024-10-24T19:00:25.576ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c63dd3d-b3f0-4464-8979-f422b528130b", "content-length": "26", "date": "Thu, 24 Oct 2024 19:00:25 GMT"} })
2742024-10-24T19:00:25.576ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1118 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2752024-10-24T19:00:25.577ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1150 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
2762024-10-24T19:00:25.605ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
2772024-10-24T19:00:25.606ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ffecca8-ead5-465a-a596-ab9e6b429797", "content-length": "4", "date": "Thu, 24 Oct 2024 19:00:24 GMT"} })
2782024-10-24T19:00:25.608ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 51c1446e-49e7-4598-8832-f33ccdf3c076
2792024-10-24T19:00:25.608ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0
2802024-10-24T19:00:25.611ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 51c1446e-49e7-4598-8832-f33ccdf3c076
2812024-10-24T19:00:25.611ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0
2822024-10-24T19:00:25.617ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
2832024-10-24T19:00:25.617ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
2842024-10-24T19:00:25.681ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = 4adb4920-442e-4d65-bb79-cc0009bb1b22 records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-10-24T19:00:25.624439Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 68627db6-53a8-4390-a3e6-e94f65d72ce7, time_modified: Some(2024-10-24T19:00:25.624439Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 76e3412a-829f-45e7-a8cf-d891529a31cf, time_modified: Some(2024-10-24T19:00:25.624439Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0 saga_name = instance-update
2852024-10-24T19:00:25.681ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 51c1446e-49e7-4598-8832-f33ccdf3c076
2862024-10-24T19:00:25.681ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0
2872024-10-24T19:00:25.684ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 51c1446e-49e7-4598-8832-f33ccdf3c076
2882024-10-24T19:00:25.684ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0
2892024-10-24T19:00:25.687ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = 4adb4920-442e-4d65-bb79-cc0009bb1b22 saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0 saga_name = instance-update
2902024-10-24T19:00:25.687ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0 saga_name = instance-update saga_node = UnassignOximeterProducer
2912024-10-24T19:00:25.688ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0 saga_name = instance-update saga_node = UnassignOximeterProducer
2922024-10-24T19:00:25.691ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = d3774998-58a6-4b89-8d53-ad0f914d458d producer_id = 4adb4920-442e-4d65-bb79-cc0009bb1b22 saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0 saga_name = instance-update
2932024-10-24T19:00:25.691ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0 saga_name = instance-update saga_node = UnassignOximeterProducer
2942024-10-24T19:00:25.691ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0 saga_name = instance-update saga_node = UnassignOximeterProducer
2952024-10-24T19:00:25.727ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:337 id = 4adb4920-442e-4d65-bb79-cc0009bb1b22 saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0 saga_name = instance-update
2962024-10-24T19:00:25.727ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = 4adb4920-442e-4d65-bb79-cc0009bb1b22 saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/4adb4920-442e-4d65-bb79-cc0009bb1b22
2972024-10-24T19:00:25.735ZDEBGnexus (SagaExecutor): client response oximeter-collector = 4adb4920-442e-4d65-bb79-cc0009bb1b22 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/4adb4920-442e-4d65-bb79-cc0009bb1b22", status: 204, headers: {"x-request-id": "f85c3528-fd53-49d4-b093-d66f65a4a498", "date": "Thu, 24 Oct 2024 19:00:25 GMT"} }) saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0 saga_name = instance-update
2982024-10-24T19:00:25.735ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = d3774998-58a6-4b89-8d53-ad0f914d458d producer_id = 4adb4920-442e-4d65-bb79-cc0009bb1b22 saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0 saga_name = instance-update
2992024-10-24T19:00:25.736ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 51c1446e-49e7-4598-8832-f33ccdf3c076
3002024-10-24T19:00:25.736ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0
3012024-10-24T19:00:25.739ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 51c1446e-49e7-4598-8832-f33ccdf3c076
3022024-10-24T19:00:25.739ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0
3032024-10-24T19:00:25.743ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = 4adb4920-442e-4d65-bb79-cc0009bb1b22 lock = UpdaterLock { updater_id: cb0b3e4a-3ef3-434a-8e98-40032dad08a7, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-10-24T19:00:25.466408265Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0 saga_name = instance-update
3042024-10-24T19:00:25.745ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0 saga_name = instance-update saga_node = CommitInstanceUpdates
3052024-10-24T19:00:25.745ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0 saga_name = instance-update saga_node = CommitInstanceUpdates
3062024-10-24T19:00:25.790ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = 4adb4920-442e-4d65-bb79-cc0009bb1b22 new_runtime = InstanceRuntimeState { time_updated: 2024-10-24T19:00:25.466408265Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0 saga_name = instance-update
3072024-10-24T19:00:25.790ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 51c1446e-49e7-4598-8832-f33ccdf3c076
3082024-10-24T19:00:25.790ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0
3092024-10-24T19:00:25.790ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Signaled
3102024-10-24T19:00:25.790ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Signaled
3112024-10-24T19:00:25.790ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3122024-10-24T19:00:25.790ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
3132024-10-24T19:00:25.790ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3142024-10-24T19:00:25.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3152024-10-24T19:00:25.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3162024-10-24T19:00:25.792ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3172024-10-24T19:00:25.793ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 51c1446e-49e7-4598-8832-f33ccdf3c076
3182024-10-24T19:00:25.793ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0
3192024-10-24T19:00:25.794ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
3202024-10-24T19:00:25.794ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3212024-10-24T19:00:25.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3222024-10-24T19:00:25.795ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3232024-10-24T19:00:25.796ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 51c1446e-49e7-4598-8832-f33ccdf3c076
3242024-10-24T19:00:25.796ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("4adb4920-442e-4d65-bb79-cc0009bb1b22"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("c85c899f-ce35-4683-8b9b-bf19ff626756")}) node_id = 7 saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0
3252024-10-24T19:00:25.797ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
3262024-10-24T19:00:25.797ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3272024-10-24T19:00:25.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3282024-10-24T19:00:25.799ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 51c1446e-49e7-4598-8832-f33ccdf3c076
3292024-10-24T19:00:25.799ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0
3302024-10-24T19:00:25.801ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3312024-10-24T19:00:25.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3322024-10-24T19:00:25.803ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 51c1446e-49e7-4598-8832-f33ccdf3c076
3332024-10-24T19:00:25.803ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0
3342024-10-24T19:00:25.807ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 51c1446e-49e7-4598-8832-f33ccdf3c076
3352024-10-24T19:00:25.807ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0
3362024-10-24T19:00:25.810ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = 4adb4920-442e-4d65-bb79-cc0009bb1b22 propolis_id = c85c899f-ce35-4683-8b9b-bf19ff626756 saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0 saga_name = instance-update
3372024-10-24T19:00:25.810ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0 saga_name = instance-update saga_node = ReleaseSledResources
3382024-10-24T19:00:25.810ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0 saga_name = instance-update saga_node = ReleaseSledResources
3392024-10-24T19:00:25.811ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3402024-10-24T19:00:25.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3412024-10-24T19:00:25.834ZINFOnexus (BackgroundTasks): VPC route manager sled 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
3422024-10-24T19:00:25.834ZDEBGnexus (BackgroundTasks): client request SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
3432024-10-24T19:00:25.834ZDEBGnexus (BackgroundTasks): client response SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "286cde12-81f2-4e0e-9894-2acc017347b5", "content-length": "372", "date": "Thu, 24 Oct 2024 19:00:25 GMT"} })
3442024-10-24T19:00:25.834ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3452024-10-24T19:00:25.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3462024-10-24T19:00:25.836ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3472024-10-24T19:00:25.838ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
3482024-10-24T19:00:25.838ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3492024-10-24T19:00:25.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3502024-10-24T19:00:25.840ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3512024-10-24T19:00:25.842ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
3522024-10-24T19:00:25.842ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3532024-10-24T19:00:25.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3542024-10-24T19:00:25.849ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 51c1446e-49e7-4598-8832-f33ccdf3c076
3552024-10-24T19:00:25.849ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0
3562024-10-24T19:00:25.852ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {ccf2364a-245f-4421-aebc-9a7b72c5bb68: {10.151.1.176: {709622ef-4307-45dd-9bd5-a14dab0b93f3}, 10.151.1.175: {709622ef-4307-45dd-9bd5-a14dab0b93f3}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
3572024-10-24T19:00:25.852ZDEBGnexus (BackgroundTasks): client request SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
3582024-10-24T19:00:25.852ZDEBGnexus (BackgroundTasks): client response SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b3b99869-7c83-4075-b131-6d6a55ceb2b6", "date": "Thu, 24 Oct 2024 19:00:25 GMT"} })
3592024-10-24T19:00:25.852ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3602024-10-24T19:00:25.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3612024-10-24T19:00:25.853ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 51c1446e-49e7-4598-8832-f33ccdf3c076
3622024-10-24T19:00:25.853ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0
3632024-10-24T19:00:25.853ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3642024-10-24T19:00:25.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3652024-10-24T19:00:25.856ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = 4adb4920-442e-4d65-bb79-cc0009bb1b22 propolis_id = c85c899f-ce35-4683-8b9b-bf19ff626756 saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0 saga_name = instance-update
3662024-10-24T19:00:25.856ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0 saga_name = instance-update saga_node = MarkVmmDeleted
3672024-10-24T19:00:25.856ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0 saga_name = instance-update saga_node = MarkVmmDeleted
3682024-10-24T19:00:25.857ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3692024-10-24T19:00:25.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3702024-10-24T19:00:25.880ZDEBGnexus (BackgroundTasks): client request SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
3712024-10-24T19:00:25.880ZDEBGnexus (BackgroundTasks): client response SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "b73b2313-2981-4adf-9c97-f0a4ed75b3e5", "content-length": "691", "date": "Thu, 24 Oct 2024 19:00:25 GMT"} })
3722024-10-24T19:00:25.880ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
3732024-10-24T19:00:25.880ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
3742024-10-24T19:00:25.880ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
3752024-10-24T19:00:25.883ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 93.381389ms iteration = 12 status = {}
3762024-10-24T19:00:25.884ZINFOnexus (BackgroundTasks): VPC route manager sled 8ed5384f-0099-459e-a18a-fdd93abd3452 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
3772024-10-24T19:00:25.884ZDEBGnexus (BackgroundTasks): client request SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
3782024-10-24T19:00:25.884ZDEBGnexus (BackgroundTasks): client response SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b0d00741-d095-4f94-9340-47665cb2127b", "date": "Thu, 24 Oct 2024 19:00:25 GMT"} })
3792024-10-24T19:00:25.886ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 96.431347ms iteration = 12 status = {}
3802024-10-24T19:00:25.919ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 51c1446e-49e7-4598-8832-f33ccdf3c076
3812024-10-24T19:00:25.919ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0
3822024-10-24T19:00:25.924ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 51c1446e-49e7-4598-8832-f33ccdf3c076
3832024-10-24T19:00:25.924ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0
3842024-10-24T19:00:25.927ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 51c1446e-49e7-4598-8832-f33ccdf3c076
3852024-10-24T19:00:25.927ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0
3862024-10-24T19:00:25.931ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 51c1446e-49e7-4598-8832-f33ccdf3c076
3872024-10-24T19:00:25.931ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0
3882024-10-24T19:00:25.934ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0 saga_name = instance-update saga_node = ChainSuccessorSaga
3892024-10-24T19:00:25.934ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0 saga_name = instance-update saga_node = ChainSuccessorSaga
3902024-10-24T19:00:25.936ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0 saga_name = instance-update saga_node = ChainSuccessorSaga
3912024-10-24T19:00:25.936ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0 saga_name = instance-update saga_node = ChainSuccessorSaga
3922024-10-24T19:00:25.938ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0 saga_name = instance-update saga_node = ChainSuccessorSaga
3932024-10-24T19:00:25.938ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0 saga_name = instance-update saga_node = ChainSuccessorSaga
3942024-10-24T19:00:25.940ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0 saga_name = instance-update saga_node = ChainSuccessorSaga
3952024-10-24T19:00:25.943ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 68627db6-53a8-4390-a3e6-e94f65d72ce7, lookup_type: ById(68627db6-53a8-4390-a3e6-e94f65d72ce7) }, key: 76e3412a-829f-45e7-a8cf-d891529a31cf, lookup_type: ById(76e3412a-829f-45e7-a8cf-d891529a31cf) }, key: 4adb4920-442e-4d65-bb79-cc0009bb1b22, lookup_type: ById(4adb4920-442e-4d65-bb79-cc0009bb1b22) } result = Ok(()) saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0 saga_name = instance-update saga_node = ChainSuccessorSaga
3962024-10-24T19:00:25.943ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0 saga_name = instance-update saga_node = ChainSuccessorSaga
3972024-10-24T19:00:25.943ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0 saga_name = instance-update saga_node = ChainSuccessorSaga
3982024-10-24T19:00:25.949ZDEBGnexus (SagaExecutor): instance update: instance will not reincarnate auto_restart_config = InstanceAutoRestart { policy: None, cooldown: None } instance_id = 4adb4920-442e-4d65-bb79-cc0009bb1b22 karmic_state = WillReincarnate needs_reincarnation = false saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0 saga_name = instance-update
3992024-10-24T19:00:25.949ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 51c1446e-49e7-4598-8832-f33ccdf3c076
4002024-10-24T19:00:25.949ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0
4012024-10-24T19:00:25.952ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 51c1446e-49e7-4598-8832-f33ccdf3c076
4022024-10-24T19:00:25.952ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0
4032024-10-24T19:00:25.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 49e2c37d-b66d-42e8-b426-ca7f987ddfc3 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
4042024-10-24T19:00:25.956ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 51c1446e-49e7-4598-8832-f33ccdf3c076
4052024-10-24T19:00:25.956ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0
4062024-10-24T19:00:25.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 49e2c37d-b66d-42e8-b426-ca7f987ddfc3 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
4072024-10-24T19:00:25.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1683 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 49e2c37d-b66d-42e8-b426-ca7f987ddfc3 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
4082024-10-24T19:00:25.959ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0 sec_id = 51c1446e-49e7-4598-8832-f33ccdf3c076
4092024-10-24T19:00:25.959ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0
4102024-10-24T19:00:25.966ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0 saga_name = instance-update sec_id = 51c1446e-49e7-4598-8832-f33ccdf3c076
4112024-10-24T19:00:25.966ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0 saga_name = instance-update saga_result = SagaResult { saga_id: 04dc6fcb-8aa1-42ad-9070-381590ee9fb0, saga_log: SagaLog { saga_id: 04dc6fcb-8aa1-42ad-9070-381590ee9fb0, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("cb0b3e4a-3ef3-434a-8e98-40032dad08a7")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("cb0b3e4a-3ef3-434a-8e98-40032dad08a7")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("4adb4920-442e-4d65-bb79-cc0009bb1b22"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("c85c899f-ce35-4683-8b9b-bf19ff626756")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("4adb4920-442e-4d65-bb79-cc0009bb1b22"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("c85c899f-ce35-4683-8b9b-bf19ff626756")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("cb0b3e4a-3ef3-434a-8e98-40032dad08a7"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("cb0b3e4a-3ef3-434a-8e98-40032dad08a7")}} }) }
4122024-10-24T19:00:25.966ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = 04dc6fcb-8aa1-42ad-9070-381590ee9fb0 instance_id = 4adb4920-442e-4d65-bb79-cc0009bb1b22 saga_id = 209286e0-a004-4506-867d-92b22cab4cf5 saga_name = start-instance-update
4132024-10-24T19:00:25.966ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 51c1446e-49e7-4598-8832-f33ccdf3c076
4142024-10-24T19:00:25.966ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 209286e0-a004-4506-867d-92b22cab4cf5
4152024-10-24T19:00:25.969ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 51c1446e-49e7-4598-8832-f33ccdf3c076
4162024-10-24T19:00:25.969ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 209286e0-a004-4506-867d-92b22cab4cf5
4172024-10-24T19:00:25.972ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 51c1446e-49e7-4598-8832-f33ccdf3c076
4182024-10-24T19:00:25.972ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 209286e0-a004-4506-867d-92b22cab4cf5
4192024-10-24T19:00:25.975ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 209286e0-a004-4506-867d-92b22cab4cf5 sec_id = 51c1446e-49e7-4598-8832-f33ccdf3c076
4202024-10-24T19:00:25.975ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 209286e0-a004-4506-867d-92b22cab4cf5
4212024-10-24T19:00:26.008ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 209286e0-a004-4506-867d-92b22cab4cf5 saga_name = start-instance-update sec_id = 51c1446e-49e7-4598-8832-f33ccdf3c076
4222024-10-24T19:00:26.008ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 209286e0-a004-4506-867d-92b22cab4cf5 saga_name = start-instance-update saga_result = SagaResult { saga_id: 209286e0-a004-4506-867d-92b22cab4cf5, saga_log: SagaLog { saga_id: 209286e0-a004-4506-867d-92b22cab4cf5, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("b999d92a-d5d2-458a-9da7-b78eb291a0e4")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("b999d92a-d5d2-458a-9da7-b78eb291a0e4")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("b999d92a-d5d2-458a-9da7-b78eb291a0e4"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("b999d92a-d5d2-458a-9da7-b78eb291a0e4")}} }) }
4232024-10-24T19:00:26.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59130 req_id = 36b12201-e09e-48ff-b5ac-2f26cfee3590 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
4242024-10-24T19:00:26.416ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59130 req_id = 36b12201-e09e-48ff-b5ac-2f26cfee3590 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
4252024-10-24T19:00:26.419ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3412 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59130 req_id = 36b12201-e09e-48ff-b5ac-2f26cfee3590 response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
4262024-10-24T19:00:26.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = cd45b556-725f-4702-83fb-fc3e79d42af4 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
4272024-10-24T19:00:26.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = cd45b556-725f-4702-83fb-fc3e79d42af4 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
4282024-10-24T19:00:26.981ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2179 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = cd45b556-725f-4702-83fb-fc3e79d42af4 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
4292024-10-24T19:00:27.421ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59130 req_id = b5f26ac4-6b5d-4131-be32-3562a53304e3 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
4302024-10-24T19:00:27.421ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59130 req_id = b5f26ac4-6b5d-4131-be32-3562a53304e3 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
4312024-10-24T19:00:27.423ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2359 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59130 req_id = b5f26ac4-6b5d-4131-be32-3562a53304e3 response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
4322024-10-24T19:00:28.001ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 75d39f6e-0981-406f-9a27-57cacacf30cc roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
4332024-10-24T19:00:28.002ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 75d39f6e-0981-406f-9a27-57cacacf30cc resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
4342024-10-24T19:00:28.003ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1654 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 75d39f6e-0981-406f-9a27-57cacacf30cc response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
4352024-10-24T19:00:28.532ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
4362024-10-24T19:00:28.532ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4372024-10-24T19:00:28.532ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
4382024-10-24T19:00:28.532ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
4392024-10-24T19:00:28.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4402024-10-24T19:00:28.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
4412024-10-24T19:00:28.533ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
4422024-10-24T19:00:28.533ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
4432024-10-24T19:00:28.533ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
4442024-10-24T19:00:28.533ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
4452024-10-24T19:00:28.533ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
4462024-10-24T19:00:28.533ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 8.61\u{b5}s iteration = 12 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
4472024-10-24T19:00:28.533ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4482024-10-24T19:00:28.533ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
4492024-10-24T19:00:28.533ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
4502024-10-24T19:00:28.533ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.32\u{b5}s iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
4512024-10-24T19:00:28.533ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
4522024-10-24T19:00:28.533ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
4532024-10-24T19:00:28.533ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
4542024-10-24T19:00:28.533ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 2.67\u{b5}s iteration = 12 status = {"errors":[],"records_set_to_done":[]}
4552024-10-24T19:00:28.533ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
4562024-10-24T19:00:28.533ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
4572024-10-24T19:00:28.533ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 3.6\u{b5}s iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
4582024-10-24T19:00:28.533ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
4592024-10-24T19:00:28.533ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4602024-10-24T19:00:28.533ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
4612024-10-24T19:00:28.533ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
4622024-10-24T19:00:28.533ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
4632024-10-24T19:00:28.533ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
4642024-10-24T19:00:28.533ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4652024-10-24T19:00:28.533ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4662024-10-24T19:00:28.533ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
4672024-10-24T19:00:28.533ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4682024-10-24T19:00:28.533ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
4692024-10-24T19:00:28.533ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
4702024-10-24T19:00:28.533ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4712024-10-24T19:00:28.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4722024-10-24T19:00:28.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
4732024-10-24T19:00:28.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
4742024-10-24T19:00:28.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4752024-10-24T19:00:28.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
4762024-10-24T19:00:28.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4772024-10-24T19:00:28.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4782024-10-24T19:00:28.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4792024-10-24T19:00:28.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4802024-10-24T19:00:28.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
4812024-10-24T19:00:28.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4822024-10-24T19:00:28.535ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8ed5384f-0099-459e-a18a-fdd93abd3452.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8ed5384f-0099-459e-a18a-fdd93abd3452.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3271, tv_nsec: 900476226 } })
4832024-10-24T19:00:28.535ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1105
4842024-10-24T19:00:28.536ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8ed5384f-0099-459e-a18a-fdd93abd3452.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8ed5384f-0099-459e-a18a-fdd93abd3452.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3271, tv_nsec: 901368060 } })
4852024-10-24T19:00:28.536ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.016486ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
4862024-10-24T19:00:28.536ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1105
4872024-10-24T19:00:28.537ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
4882024-10-24T19:00:28.537ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
4892024-10-24T19:00:28.537ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
4902024-10-24T19:00:28.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
4912024-10-24T19:00:28.537ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4922024-10-24T19:00:28.537ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4932024-10-24T19:00:28.538ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4942024-10-24T19:00:28.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4952024-10-24T19:00:28.538ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4962024-10-24T19:00:28.539ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4972024-10-24T19:00:28.539ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
4982024-10-24T19:00:28.539ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4992024-10-24T19:00:28.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5002024-10-24T19:00:28.539ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
5012024-10-24T19:00:28.539ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5022024-10-24T19:00:28.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5032024-10-24T19:00:28.541ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
5042024-10-24T19:00:28.541ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5052024-10-24T19:00:28.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5062024-10-24T19:00:28.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5072024-10-24T19:00:28.541ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5082024-10-24T19:00:28.542ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
5092024-10-24T19:00:28.542ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5102024-10-24T19:00:28.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5112024-10-24T19:00:28.543ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
5122024-10-24T19:00:28.543ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
5132024-10-24T19:00:28.543ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5142024-10-24T19:00:28.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5152024-10-24T19:00:28.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
5162024-10-24T19:00:28.544ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5172024-10-24T19:00:28.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5182024-10-24T19:00:28.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5192024-10-24T19:00:28.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5202024-10-24T19:00:28.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5212024-10-24T19:00:28.545ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5222024-10-24T19:00:28.546ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8ed5384f-0099-459e-a18a-fdd93abd3452.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8ed5384f-0099-459e-a18a-fdd93abd3452.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3271, tv_nsec: 911698719 } })
5232024-10-24T19:00:28.546ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5242024-10-24T19:00:28.546ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1105 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674
5252024-10-24T19:00:28.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5262024-10-24T19:00:28.547ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5272024-10-24T19:00:28.547ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5282024-10-24T19:00:28.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5292024-10-24T19:00:28.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5302024-10-24T19:00:28.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5312024-10-24T19:00:28.548ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5322024-10-24T19:00:28.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5332024-10-24T19:00:28.549ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5342024-10-24T19:00:28.549ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5352024-10-24T19:00:28.550ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
5362024-10-24T19:00:28.550ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 16.600356ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
5372024-10-24T19:00:28.551ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
5382024-10-24T19:00:28.551ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5392024-10-24T19:00:28.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5402024-10-24T19:00:28.551ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
5412024-10-24T19:00:28.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5422024-10-24T19:00:28.552ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: fbb59198-7d6e-40d8-9b05-3fd3707f9c53, lookup_type: ById(fbb59198-7d6e-40d8-9b05-3fd3707f9c53) } result = Ok(())
5432024-10-24T19:00:28.552ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5442024-10-24T19:00:28.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5452024-10-24T19:00:28.574ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = fbb59198-7d6e-40d8-9b05-3fd3707f9c53 original_time_created = 2024-10-24 18:54:46.689131 UTC target_id = fbb59198-7d6e-40d8-9b05-3fd3707f9c53 time_created = 2024-10-24 18:54:46.689131 UTC
5462024-10-24T19:00:28.574ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 41.084824ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"fbb59198-7d6e-40d8-9b05-3fd3707f9c53","time_created":"2024-10-24T18:54:46.689131Z"}
5472024-10-24T19:00:28.580ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5482024-10-24T19:00:28.581ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
5492024-10-24T19:00:28.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5502024-10-24T19:00:28.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
5512024-10-24T19:00:28.581ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 47.970569ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
5522024-10-24T19:00:28.584ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5532024-10-24T19:00:28.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5542024-10-24T19:00:28.586ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
5552024-10-24T19:00:28.586ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
5562024-10-24T19:00:28.586ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 53.2257ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
5572024-10-24T19:00:28.609ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 75.843539ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
5582024-10-24T19:00:28.610ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5592024-10-24T19:00:28.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8ed5384f-0099-459e-a18a-fdd93abd3452, lookup_type: ById(8ed5384f-0099-459e-a18a-fdd93abd3452) } result = Ok(())
5602024-10-24T19:00:28.613ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5612024-10-24T19:00:28.613ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1113 zone_address = fd00:1122:3344:101::2
5622024-10-24T19:00:28.613ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
5632024-10-24T19:00:28.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5642024-10-24T19:00:28.613ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dac3faae-01e9-4267-9f4a-e906c630c7d5", "content-length": "26", "date": "Thu, 24 Oct 2024 19:00:28 GMT"} })
5652024-10-24T19:00:28.613ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1118 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
5662024-10-24T19:00:28.615ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1150 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
5672024-10-24T19:00:28.615ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 82.075635ms iteration = 12 status = 0
5682024-10-24T19:00:28.643ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 109.488418ms iteration = 14 status = {"physical_disks_added":0}
5692024-10-24T19:00:28.665ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
5702024-10-24T19:00:28.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5712024-10-24T19:00:28.676ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1113 zone_address = fd00:1122:3344:101::2
5722024-10-24T19:00:28.676ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
5732024-10-24T19:00:28.677ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "66bbbfa1-7e4a-4682-a9c4-b3089248d55c", "content-length": "26", "date": "Thu, 24 Oct 2024 19:00:28 GMT"} })
5742024-10-24T19:00:28.677ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1118 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
5752024-10-24T19:00:28.679ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1150 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
5762024-10-24T19:00:28.725ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1113 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 zone_address = fd00:1122:3344:101::2
5772024-10-24T19:00:28.725ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
5782024-10-24T19:00:28.725ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "22972630-8e6e-4d01-b918-e95c915293f7", "content-length": "26", "date": "Thu, 24 Oct 2024 19:00:28 GMT"} })
5792024-10-24T19:00:28.725ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1118 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
5802024-10-24T19:00:28.726ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
5812024-10-24T19:00:28.727ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "28b69214-d540-418f-b281-f8ffb7bea022", "content-length": "2", "date": "Thu, 24 Oct 2024 19:00:27 GMT"} })
5822024-10-24T19:00:28.727ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1150 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674
5832024-10-24T19:00:28.728ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
5842024-10-24T19:00:28.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
5852024-10-24T19:00:28.780ZINFOnexus (BackgroundTasks): VPC route manager sled 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
5862024-10-24T19:00:28.780ZDEBGnexus (BackgroundTasks): client request SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
5872024-10-24T19:00:28.780ZDEBGnexus (BackgroundTasks): client response SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "70a75da7-e1f2-4a39-b6cb-750f7bf0c3ad", "content-length": "372", "date": "Thu, 24 Oct 2024 19:00:28 GMT"} })
5882024-10-24T19:00:28.780ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5892024-10-24T19:00:28.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5902024-10-24T19:00:28.783ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 250.653894ms iteration = 12 status = null
5912024-10-24T19:00:28.812ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 279.5843ms iteration = 12 status = {}
5922024-10-24T19:00:28.819ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5932024-10-24T19:00:28.821ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
5942024-10-24T19:00:28.821ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
5952024-10-24T19:00:28.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5962024-10-24T19:00:28.822ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5972024-10-24T19:00:28.824ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
5982024-10-24T19:00:28.824ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
5992024-10-24T19:00:28.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6002024-10-24T19:00:28.829ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
6012024-10-24T19:00:28.829ZDEBGnexus (BackgroundTasks): client request SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
6022024-10-24T19:00:28.829ZDEBGnexus (BackgroundTasks): client response SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "03bdb65a-6088-4df4-88d4-80348e1ec470", "date": "Thu, 24 Oct 2024 19:00:28 GMT"} })
6032024-10-24T19:00:28.829ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6042024-10-24T19:00:28.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6052024-10-24T19:00:28.832ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6062024-10-24T19:00:28.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6072024-10-24T19:00:28.836ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6082024-10-24T19:00:28.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6092024-10-24T19:00:28.844ZINFOnexus (BackgroundTasks): VPC route manager sled 8ed5384f-0099-459e-a18a-fdd93abd3452 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
6102024-10-24T19:00:28.844ZDEBGnexus (BackgroundTasks): client request SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
6112024-10-24T19:00:28.845ZDEBGnexus (BackgroundTasks): client response SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e6cb743f-200d-411b-a74c-c01cdf3cfd80", "date": "Thu, 24 Oct 2024 19:00:28 GMT"} })
6122024-10-24T19:00:28.846ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 313.433562ms iteration = 13 status = {}
6132024-10-24T19:00:28.884ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6142024-10-24T19:00:28.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6152024-10-24T19:00:28.887ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 95766534-d8e7-4baf-bb18-72c7cf344605, rack_id: d6d74c37-fa13-4dad-8a2e-066574b53674, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(d796208a-628d-40ec-83c5-b72b8cbc0e00) } rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 switch_location = Switch0
6162024-10-24T19:00:28.887ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6172024-10-24T19:00:28.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6182024-10-24T19:00:28.896ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
6192024-10-24T19:00:28.897ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5541190-000e-475b-aafa-df311de87b3f", "content-length": "121", "date": "Thu, 24 Oct 2024 19:00:27 GMT"} })
6202024-10-24T19:00:28.897ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
6212024-10-24T19:00:28.897ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = d796208a-628d-40ec-83c5-b72b8cbc0e00
6222024-10-24T19:00:28.897ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
6232024-10-24T19:00:28.897ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
6242024-10-24T19:00:28.897ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
6252024-10-24T19:00:28.897ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
6262024-10-24T19:00:28.897ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
6272024-10-24T19:00:28.897ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
6282024-10-24T19:00:28.897ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
6292024-10-24T19:00:28.897ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
6302024-10-24T19:00:28.898ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674
6312024-10-24T19:00:28.898ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6322024-10-24T19:00:28.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6332024-10-24T19:00:28.900ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
6342024-10-24T19:00:28.900ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f80be6c-0b4b-40d6-bf57-11aaced84daa", "content-length": "2", "date": "Thu, 24 Oct 2024 19:00:27 GMT"} })
6352024-10-24T19:00:28.900ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
6362024-10-24T19:00:28.900ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "db053a33-f327-487f-a1a8-64cbe8440c64", "content-length": "52", "date": "Thu, 24 Oct 2024 19:00:27 GMT"} })
6372024-10-24T19:00:28.900ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 switch_location = Switch0
6382024-10-24T19:00:28.900ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
6392024-10-24T19:00:28.920ZDEBGnexus (BackgroundTasks): client request SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
6402024-10-24T19:00:29.012ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "cc67e563-ef5e-43d3-9154-ed85fbdbb6c6", "date": "Thu, 24 Oct 2024 19:00:28 GMT"} })
6412024-10-24T19:00:29.012ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 switch = Switch0
6422024-10-24T19:00:29.012ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
6432024-10-24T19:00:29.012ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "edd06c56-bd4d-4ace-b288-9eebfa5ef1e8", "content-length": "669", "date": "Thu, 24 Oct 2024 19:00:29 GMT"} })
6442024-10-24T19:00:29.012ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6452024-10-24T19:00:29.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6462024-10-24T19:00:29.012ZDEBGnexus (BackgroundTasks): client response SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ce5ccde6-c57f-476a-a5e1-b0ca4fedba41", "content-length": "691", "date": "Thu, 24 Oct 2024 19:00:29 GMT"} })
6472024-10-24T19:00:29.012ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
6482024-10-24T19:00:29.013ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
6492024-10-24T19:00:29.013ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
6502024-10-24T19:00:29.015ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 481.568284ms iteration = 13 status = {}
6512024-10-24T19:00:29.017ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6522024-10-24T19:00:29.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6532024-10-24T19:00:29.021ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6542024-10-24T19:00:29.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6552024-10-24T19:00:29.023ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6562024-10-24T19:00:29.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6572024-10-24T19:00:29.031ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 498.152269ms iteration = 12 status = {}
6582024-10-24T19:00:29.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 20ac9e7a-e179-45c3-8f13-8b63b3086d89 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
6592024-10-24T19:00:29.138ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 20ac9e7a-e179-45c3-8f13-8b63b3086d89 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
6602024-10-24T19:00:29.141ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3262 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 20ac9e7a-e179-45c3-8f13-8b63b3086d89 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
6612024-10-24T19:00:29.331ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 514 local_addr = [fd00:1122:3344:101::b]:60338 method = GET remote_addr = [fd00:1122:3344:101::d]:39079 req_id = 4c30abfd-a161-4004-9f24-08797df760c8 response_code = 200 uri = /51c1446e-49e7-4598-8832-f33ccdf3c076
6622024-10-24T19:00:30.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = b86ac2b2-9512-4cb2-8327-ff78eaf84770 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
6632024-10-24T19:00:30.165ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = b86ac2b2-9512-4cb2-8327-ff78eaf84770 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
6642024-10-24T19:00:30.167ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2590 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = b86ac2b2-9512-4cb2-8327-ff78eaf84770 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
6652024-10-24T19:00:31.187ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = f3300d30-9237-45f3-9231-c5d868035658 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
6662024-10-24T19:00:31.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = f3300d30-9237-45f3-9231-c5d868035658 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
6672024-10-24T19:00:31.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3080 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = f3300d30-9237-45f3-9231-c5d868035658 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
6682024-10-24T19:00:32.212ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = dd1bb6ca-0fc5-421d-84a8-9dcb6b27614a roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
6692024-10-24T19:00:32.213ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = dd1bb6ca-0fc5-421d-84a8-9dcb6b27614a resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
6702024-10-24T19:00:32.215ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2687 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = dd1bb6ca-0fc5-421d-84a8-9dcb6b27614a response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
6712024-10-24T19:00:33.235ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 90402d9d-5da4-4429-8ba0-54d5fd3ed8c5 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
6722024-10-24T19:00:33.235ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 90402d9d-5da4-4429-8ba0-54d5fd3ed8c5 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
6732024-10-24T19:00:33.237ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2422 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 90402d9d-5da4-4429-8ba0-54d5fd3ed8c5 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
6742024-10-24T19:00:34.258ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 66147832-e40c-41b3-89ee-e74e2ebecf8c roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
6752024-10-24T19:00:34.259ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 66147832-e40c-41b3-89ee-e74e2ebecf8c resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
6762024-10-24T19:00:34.261ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2563 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 66147832-e40c-41b3-89ee-e74e2ebecf8c response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
6772024-10-24T19:00:35.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 06ad8524-edee-4bb3-954e-fba5ee738f25 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
6782024-10-24T19:00:35.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 06ad8524-edee-4bb3-954e-fba5ee738f25 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
6792024-10-24T19:00:35.283ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2917 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 06ad8524-edee-4bb3-954e-fba5ee738f25 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
6802024-10-24T19:00:36.303ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 865cee0b-2462-4e62-b4d1-bee4edef3aeb roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
6812024-10-24T19:00:36.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 865cee0b-2462-4e62-b4d1-bee4edef3aeb resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
6822024-10-24T19:00:36.306ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2533 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 865cee0b-2462-4e62-b4d1-bee4edef3aeb response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
6832024-10-24T19:00:37.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 14e1b6c1-e491-45d2-a14d-3f8093f15e98 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
6842024-10-24T19:00:37.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 14e1b6c1-e491-45d2-a14d-3f8093f15e98 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
6852024-10-24T19:00:37.327ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2462 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 14e1b6c1-e491-45d2-a14d-3f8093f15e98 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
6862024-10-24T19:00:38.348ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 54ea0438-86d3-4cbb-a64d-8d7127fb156c roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
6872024-10-24T19:00:38.348ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 54ea0438-86d3-4cbb-a64d-8d7127fb156c resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
6882024-10-24T19:00:38.350ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2307 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 54ea0438-86d3-4cbb-a64d-8d7127fb156c response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
6892024-10-24T19:00:38.533ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
6902024-10-24T19:00:38.533ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6912024-10-24T19:00:38.533ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
6922024-10-24T19:00:38.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6932024-10-24T19:00:38.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6942024-10-24T19:00:38.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6952024-10-24T19:00:38.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6962024-10-24T19:00:38.539ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
6972024-10-24T19:00:38.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6982024-10-24T19:00:38.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6992024-10-24T19:00:38.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7002024-10-24T19:00:38.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7012024-10-24T19:00:38.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7022024-10-24T19:00:38.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: fbb59198-7d6e-40d8-9b05-3fd3707f9c53, lookup_type: ById(fbb59198-7d6e-40d8-9b05-3fd3707f9c53) } result = Ok(())
7032024-10-24T19:00:38.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7042024-10-24T19:00:38.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7052024-10-24T19:00:38.554ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = fbb59198-7d6e-40d8-9b05-3fd3707f9c53 original_time_created = 2024-10-24 18:54:46.689131 UTC target_id = fbb59198-7d6e-40d8-9b05-3fd3707f9c53 time_created = 2024-10-24 18:54:46.689131 UTC
7062024-10-24T19:00:38.554ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.812881ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"fbb59198-7d6e-40d8-9b05-3fd3707f9c53","time_created":"2024-10-24T18:54:46.689131Z"}
7072024-10-24T19:00:38.562ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7082024-10-24T19:00:38.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7092024-10-24T19:00:38.589ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.966853ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
7102024-10-24T19:00:39.331ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 861 local_addr = [fd00:1122:3344:101::b]:60338 method = GET remote_addr = [fd00:1122:3344:101::d]:39079 req_id = 0ace2e1e-9541-4250-83c4-9a345ddbef8b response_code = 200 uri = /51c1446e-49e7-4598-8832-f33ccdf3c076
7112024-10-24T19:00:39.371ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 2cfb2077-9d03-4f57-a0df-130c2aa29fab roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
7122024-10-24T19:00:39.371ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 2cfb2077-9d03-4f57-a0df-130c2aa29fab resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
7132024-10-24T19:00:39.374ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3944 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 2cfb2077-9d03-4f57-a0df-130c2aa29fab response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
7142024-10-24T19:00:40.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = c1445c83-2e2b-4e6b-92a7-f1e10675dc4d roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
7152024-10-24T19:00:40.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = c1445c83-2e2b-4e6b-92a7-f1e10675dc4d resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
7162024-10-24T19:00:40.397ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2415 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = c1445c83-2e2b-4e6b-92a7-f1e10675dc4d response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
7172024-10-24T19:00:41.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 314c0b97-6917-4c48-8d27-cf9ba426d983 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
7182024-10-24T19:00:41.416ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 314c0b97-6917-4c48-8d27-cf9ba426d983 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
7192024-10-24T19:00:41.418ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2297 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 314c0b97-6917-4c48-8d27-cf9ba426d983 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
7202024-10-24T19:00:42.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = bfd2db83-3033-4186-b478-10724c295064 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
7212024-10-24T19:00:42.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = bfd2db83-3033-4186-b478-10724c295064 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
7222024-10-24T19:00:42.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2415 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = bfd2db83-3033-4186-b478-10724c295064 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
7232024-10-24T19:00:43.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = ead3cce0-d4ee-44de-94e8-ffcd1f2c417d roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
7242024-10-24T19:00:43.463ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = ead3cce0-d4ee-44de-94e8-ffcd1f2c417d resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
7252024-10-24T19:00:43.465ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2617 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = ead3cce0-d4ee-44de-94e8-ffcd1f2c417d response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
7262024-10-24T19:00:44.486ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 2e2c0222-89bb-4830-af4b-e522514d61aa roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
7272024-10-24T19:00:44.486ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 2e2c0222-89bb-4830-af4b-e522514d61aa resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
7282024-10-24T19:00:44.488ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2204 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 2e2c0222-89bb-4830-af4b-e522514d61aa response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
7292024-10-24T19:00:45.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = dc5c6473-82e5-4c04-b072-4d866d5905e9 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
7302024-10-24T19:00:45.511ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = dc5c6473-82e5-4c04-b072-4d866d5905e9 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
7312024-10-24T19:00:45.513ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2630 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = dc5c6473-82e5-4c04-b072-4d866d5905e9 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
7322024-10-24T19:00:46.534ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 3167de6b-a85b-427d-96df-633c54f4cef2 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
7332024-10-24T19:00:46.534ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 3167de6b-a85b-427d-96df-633c54f4cef2 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
7342024-10-24T19:00:46.535ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1966 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 3167de6b-a85b-427d-96df-633c54f4cef2 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
7352024-10-24T19:00:47.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 97fc79f2-a157-4b56-a2dc-74fb65e2a435 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
7362024-10-24T19:00:47.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 97fc79f2-a157-4b56-a2dc-74fb65e2a435 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
7372024-10-24T19:00:47.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2278 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 97fc79f2-a157-4b56-a2dc-74fb65e2a435 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
7382024-10-24T19:00:48.533ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
7392024-10-24T19:00:48.533ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
7402024-10-24T19:00:48.533ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7412024-10-24T19:00:48.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7422024-10-24T19:00:48.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7432024-10-24T19:00:48.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7442024-10-24T19:00:48.536ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7452024-10-24T19:00:48.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7462024-10-24T19:00:48.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7472024-10-24T19:00:48.539ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
7482024-10-24T19:00:48.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7492024-10-24T19:00:48.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7502024-10-24T19:00:48.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7512024-10-24T19:00:48.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7522024-10-24T19:00:48.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7532024-10-24T19:00:48.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: fbb59198-7d6e-40d8-9b05-3fd3707f9c53, lookup_type: ById(fbb59198-7d6e-40d8-9b05-3fd3707f9c53) } result = Ok(())
7542024-10-24T19:00:48.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7552024-10-24T19:00:48.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7562024-10-24T19:00:48.554ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = fbb59198-7d6e-40d8-9b05-3fd3707f9c53 original_time_created = 2024-10-24 18:54:46.689131 UTC target_id = fbb59198-7d6e-40d8-9b05-3fd3707f9c53 time_created = 2024-10-24 18:54:46.689131 UTC
7572024-10-24T19:00:48.554ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.75666ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"fbb59198-7d6e-40d8-9b05-3fd3707f9c53","time_created":"2024-10-24T18:54:46.689131Z"}
7582024-10-24T19:00:48.565ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.503636ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
7592024-10-24T19:00:48.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 5ad1caa5-ef42-4f90-a36d-72aa0574ecc4 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
7602024-10-24T19:00:48.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 5ad1caa5-ef42-4f90-a36d-72aa0574ecc4 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
7612024-10-24T19:00:48.580ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2008 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 5ad1caa5-ef42-4f90-a36d-72aa0574ecc4 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
7622024-10-24T19:00:49.332ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 590 local_addr = [fd00:1122:3344:101::b]:60338 method = GET remote_addr = [fd00:1122:3344:101::d]:39079 req_id = f7ea3ecf-3c9f-492a-8e99-869519ca2166 response_code = 200 uri = /51c1446e-49e7-4598-8832-f33ccdf3c076
7632024-10-24T19:00:49.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = b52c9f77-765d-4a7f-8d84-b9aeca1b8049 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
7642024-10-24T19:00:49.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = b52c9f77-765d-4a7f-8d84-b9aeca1b8049 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
7652024-10-24T19:00:49.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2091 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = b52c9f77-765d-4a7f-8d84-b9aeca1b8049 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
7662024-10-24T19:00:50.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = f23fb94b-d7b8-46d8-aacc-a43784735677 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
7672024-10-24T19:00:50.623ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = f23fb94b-d7b8-46d8-aacc-a43784735677 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
7682024-10-24T19:00:50.625ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2642 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = f23fb94b-d7b8-46d8-aacc-a43784735677 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
7692024-10-24T19:00:51.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 0896b0f8-8d90-4f51-a300-75f58d2b79b1 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
7702024-10-24T19:00:51.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 0896b0f8-8d90-4f51-a300-75f58d2b79b1 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
7712024-10-24T19:00:51.646ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2553 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 0896b0f8-8d90-4f51-a300-75f58d2b79b1 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
7722024-10-24T19:00:52.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 20ca5668-e407-49a2-b9e2-f4a54f0b0555 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
7732024-10-24T19:00:52.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 20ca5668-e407-49a2-b9e2-f4a54f0b0555 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
7742024-10-24T19:00:52.670ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2477 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 20ca5668-e407-49a2-b9e2-f4a54f0b0555 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
7752024-10-24T19:00:53.690ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = b67156f2-8c45-47a4-9dcd-e485f101eec3 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
7762024-10-24T19:00:53.690ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = b67156f2-8c45-47a4-9dcd-e485f101eec3 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
7772024-10-24T19:00:53.692ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2057 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = b67156f2-8c45-47a4-9dcd-e485f101eec3 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
7782024-10-24T19:00:54.712ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 4503da0b-23c2-4130-be57-2133cfbf7af4 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
7792024-10-24T19:00:54.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 4503da0b-23c2-4130-be57-2133cfbf7af4 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
7802024-10-24T19:00:54.714ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2255 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 4503da0b-23c2-4130-be57-2133cfbf7af4 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
7812024-10-24T19:00:55.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = b6703e6a-0206-4b95-bc75-3736fa7d05a3 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
7822024-10-24T19:00:55.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = b6703e6a-0206-4b95-bc75-3736fa7d05a3 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
7832024-10-24T19:00:55.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3009 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = b6703e6a-0206-4b95-bc75-3736fa7d05a3 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
7842024-10-24T19:00:56.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 7b21af4f-00b5-402b-9207-583f5a76e657 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
7852024-10-24T19:00:56.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 7b21af4f-00b5-402b-9207-583f5a76e657 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
7862024-10-24T19:00:56.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2670 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 7b21af4f-00b5-402b-9207-583f5a76e657 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
7872024-10-24T19:00:57.453ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59130 req_id = 19a959f3-7f76-49d0-a216-df6295fc728d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
7882024-10-24T19:00:57.454ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59130 req_id = 19a959f3-7f76-49d0-a216-df6295fc728d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
7892024-10-24T19:00:57.457ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3324 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59130 req_id = 19a959f3-7f76-49d0-a216-df6295fc728d response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
7902024-10-24T19:00:57.785ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = c044db14-d925-478e-a16d-a7d5cf10c9c9 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
7912024-10-24T19:00:57.785ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = c044db14-d925-478e-a16d-a7d5cf10c9c9 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
7922024-10-24T19:00:57.787ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2119 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = c044db14-d925-478e-a16d-a7d5cf10c9c9 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
7932024-10-24T19:00:58.532ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
7942024-10-24T19:00:58.532ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
7952024-10-24T19:00:58.532ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
7962024-10-24T19:00:58.532ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
7972024-10-24T19:00:58.532ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
7982024-10-24T19:00:58.532ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
7992024-10-24T19:00:58.532ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-10-24 18:50:58.532538192 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
8002024-10-24T19:00:58.532ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
8012024-10-24T19:00:58.532ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
8022024-10-24T19:00:58.532ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
8032024-10-24T19:00:58.532ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
8042024-10-24T19:00:58.532ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
8052024-10-24T19:00:58.532ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
8062024-10-24T19:00:58.532ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
8072024-10-24T19:00:58.532ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
8082024-10-24T19:00:58.532ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
8092024-10-24T19:00:58.532ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
8102024-10-24T19:00:58.532ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
8112024-10-24T19:00:58.532ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
8122024-10-24T19:00:58.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
8132024-10-24T19:00:58.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
8142024-10-24T19:00:58.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
8152024-10-24T19:00:58.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
8162024-10-24T19:00:58.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
8172024-10-24T19:00:58.533ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
8182024-10-24T19:00:58.533ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8192024-10-24T19:00:58.533ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
8202024-10-24T19:00:58.533ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
8212024-10-24T19:00:58.533ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8222024-10-24T19:00:58.533ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
8232024-10-24T19:00:58.533ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
8242024-10-24T19:00:58.533ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
8252024-10-24T19:00:58.533ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
8262024-10-24T19:00:58.533ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
8272024-10-24T19:00:58.533ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8282024-10-24T19:00:58.533ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
8292024-10-24T19:00:58.533ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
8302024-10-24T19:00:58.533ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
8312024-10-24T19:00:58.533ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
8322024-10-24T19:00:58.533ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
8332024-10-24T19:00:58.533ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
8342024-10-24T19:00:58.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
8352024-10-24T19:00:58.533ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 12.72\u{b5}s iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
8362024-10-24T19:00:58.533ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
8372024-10-24T19:00:58.533ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
8382024-10-24T19:00:58.533ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.95\u{b5}s iteration = 13 status = {"errors":[],"records_set_to_done":[]}
8392024-10-24T19:00:58.533ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
8402024-10-24T19:00:58.533ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
8412024-10-24T19:00:58.533ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
8422024-10-24T19:00:58.533ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
8432024-10-24T19:00:58.533ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8442024-10-24T19:00:58.533ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = fbb59198-7d6e-40d8-9b05-3fd3707f9c53
8452024-10-24T19:00:58.533ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
8462024-10-24T19:00:58.533ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8472024-10-24T19:00:58.533ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 9.601\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"fbb59198-7d6e-40d8-9b05-3fd3707f9c53"}
8482024-10-24T19:00:58.533ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
8492024-10-24T19:00:58.533ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
8502024-10-24T19:00:58.533ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
8512024-10-24T19:00:58.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8522024-10-24T19:00:58.533ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
8532024-10-24T19:00:58.533ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 10.77\u{b5}s iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
8542024-10-24T19:00:58.533ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
8552024-10-24T19:00:58.533ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
8562024-10-24T19:00:58.533ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
8572024-10-24T19:00:58.533ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 10.77\u{b5}s iteration = 13 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
8582024-10-24T19:00:58.533ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
8592024-10-24T19:00:58.533ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8602024-10-24T19:00:58.533ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
8612024-10-24T19:00:58.533ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
8622024-10-24T19:00:58.533ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
8632024-10-24T19:00:58.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8642024-10-24T19:00:58.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
8652024-10-24T19:00:58.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8662024-10-24T19:00:58.533ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b130f689-a354-4ce5-be2b-20413d917375.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e40b6155-d379-4874-9119-51a498c972c1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e40b6155-d379-4874-9119-51a498c972c1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 3301, tv_nsec: 898321213 } })
8672024-10-24T19:00:58.533ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("06542437-1810-4294-a723-9ed308666b19.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("26818eb7-96aa-486e-ac98-9a5f4e70076d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d4b09213-5961-4095-a130-f1ddc420cb29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d4b09213-5961-4095-a130-f1ddc420cb29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 3301, tv_nsec: 898326873 } })
8682024-10-24T19:00:58.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
8692024-10-24T19:00:58.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8702024-10-24T19:00:58.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
8712024-10-24T19:00:58.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8722024-10-24T19:00:58.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8732024-10-24T19:00:58.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8742024-10-24T19:00:58.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
8752024-10-24T19:00:58.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
8762024-10-24T19:00:58.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
8772024-10-24T19:00:58.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
8782024-10-24T19:00:58.534ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
8792024-10-24T19:00:58.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8802024-10-24T19:00:58.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
8812024-10-24T19:00:58.534ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
8822024-10-24T19:00:58.534ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.598555ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
8832024-10-24T19:00:58.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
8842024-10-24T19:00:58.534ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
8852024-10-24T19:00:58.534ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
8862024-10-24T19:00:58.534ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.736327ms iteration = 7 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
8872024-10-24T19:00:58.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
8882024-10-24T19:00:58.534ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
8892024-10-24T19:00:58.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
8902024-10-24T19:00:58.534ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
8912024-10-24T19:00:58.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
8922024-10-24T19:00:58.535ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8ed5384f-0099-459e-a18a-fdd93abd3452.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8ed5384f-0099-459e-a18a-fdd93abd3452.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3301, tv_nsec: 900637038 } })
8932024-10-24T19:00:58.536ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1105
8942024-10-24T19:00:58.536ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
8952024-10-24T19:00:58.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
8962024-10-24T19:00:58.536ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
8972024-10-24T19:00:58.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
8982024-10-24T19:00:58.536ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8ed5384f-0099-459e-a18a-fdd93abd3452.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8ed5384f-0099-459e-a18a-fdd93abd3452.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3301, tv_nsec: 901542083 } })
8992024-10-24T19:00:58.537ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-10-24 18:50:58.532538192 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
9002024-10-24T19:00:58.537ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.505499ms iteration = 7 status = {"expiration":"2024-10-24T18:50:58.532538192Z","pruned":[]}
9012024-10-24T19:00:58.537ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1105
9022024-10-24T19:00:58.537ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9032024-10-24T19:00:58.539ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
9042024-10-24T19:00:58.539ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
9052024-10-24T19:00:58.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
9062024-10-24T19:00:58.540ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
9072024-10-24T19:00:58.540ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
9082024-10-24T19:00:58.540ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
9092024-10-24T19:00:58.540ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.911467ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
9102024-10-24T19:00:58.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
9112024-10-24T19:00:58.540ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9122024-10-24T19:00:58.541ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 8.059935ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
9132024-10-24T19:00:58.541ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9142024-10-24T19:00:58.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9152024-10-24T19:00:58.543ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
9162024-10-24T19:00:58.543ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9172024-10-24T19:00:58.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9182024-10-24T19:00:58.548ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9192024-10-24T19:00:58.549ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9202024-10-24T19:00:58.551ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
9212024-10-24T19:00:58.551ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
9222024-10-24T19:00:58.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
9232024-10-24T19:00:58.552ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9242024-10-24T19:00:58.552ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9252024-10-24T19:00:58.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9262024-10-24T19:00:58.555ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9272024-10-24T19:00:58.557ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
9282024-10-24T19:00:58.557ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
9292024-10-24T19:00:58.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
9302024-10-24T19:00:58.557ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9312024-10-24T19:00:58.558ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
9322024-10-24T19:00:58.558ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
9332024-10-24T19:00:58.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
9342024-10-24T19:00:58.562ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9352024-10-24T19:00:58.563ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
9362024-10-24T19:00:58.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
9372024-10-24T19:00:58.565ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
9382024-10-24T19:00:58.566ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9392024-10-24T19:00:58.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9402024-10-24T19:00:58.567ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.733831ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9412024-10-24T19:00:58.568ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9422024-10-24T19:00:58.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9432024-10-24T19:00:58.571ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
9442024-10-24T19:00:58.572ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 38.481013ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
9452024-10-24T19:00:58.573ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9462024-10-24T19:00:58.577ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: fbb59198-7d6e-40d8-9b05-3fd3707f9c53, lookup_type: ById(fbb59198-7d6e-40d8-9b05-3fd3707f9c53) } result = Ok(())
9472024-10-24T19:00:58.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9482024-10-24T19:00:58.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9492024-10-24T19:00:58.577ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9502024-10-24T19:00:58.579ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9512024-10-24T19:00:58.580ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
9522024-10-24T19:00:58.580ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9532024-10-24T19:00:58.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9542024-10-24T19:00:58.581ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
9552024-10-24T19:00:58.581ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9562024-10-24T19:00:58.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9572024-10-24T19:00:58.587ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9582024-10-24T19:00:58.588ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9592024-10-24T19:00:58.588ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9602024-10-24T19:00:58.589ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9612024-10-24T19:00:58.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9622024-10-24T19:00:58.590ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
9632024-10-24T19:00:58.590ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9642024-10-24T19:00:58.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9652024-10-24T19:00:58.590ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
9662024-10-24T19:00:58.590ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
9672024-10-24T19:00:58.591ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
9682024-10-24T19:00:58.591ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
9692024-10-24T19:00:58.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
9702024-10-24T19:00:58.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
9712024-10-24T19:00:58.591ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9722024-10-24T19:00:58.592ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9732024-10-24T19:00:58.594ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
9742024-10-24T19:00:58.594ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9752024-10-24T19:00:58.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9762024-10-24T19:00:58.595ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
9772024-10-24T19:00:58.595ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9782024-10-24T19:00:58.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9792024-10-24T19:00:58.597ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
9802024-10-24T19:00:58.597ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
9812024-10-24T19:00:58.597ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 63.583491ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
9822024-10-24T19:00:58.599ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9832024-10-24T19:00:58.599ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9842024-10-24T19:00:58.599ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8ed5384f-0099-459e-a18a-fdd93abd3452.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8ed5384f-0099-459e-a18a-fdd93abd3452.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3301, tv_nsec: 964489083 } })
9852024-10-24T19:00:58.600ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
9862024-10-24T19:00:58.600ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
9872024-10-24T19:00:58.600ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
9882024-10-24T19:00:58.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9892024-10-24T19:00:58.600ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
9902024-10-24T19:00:58.600ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1105 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674
9912024-10-24T19:00:58.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
9922024-10-24T19:00:58.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
9932024-10-24T19:00:58.600ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = fbb59198-7d6e-40d8-9b05-3fd3707f9c53 original_time_created = 2024-10-24 18:54:46.689131 UTC target_id = fbb59198-7d6e-40d8-9b05-3fd3707f9c53 time_created = 2024-10-24 18:54:46.689131 UTC
9942024-10-24T19:00:58.600ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 67.253637ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"fbb59198-7d6e-40d8-9b05-3fd3707f9c53","time_created":"2024-10-24T18:54:46.689131Z"}
9952024-10-24T19:00:58.601ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
9962024-10-24T19:00:58.601ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
9972024-10-24T19:00:58.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
9982024-10-24T19:00:58.601ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9992024-10-24T19:00:58.603ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
10002024-10-24T19:00:58.603ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
10012024-10-24T19:00:58.603ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10022024-10-24T19:00:58.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
10032024-10-24T19:00:58.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
10042024-10-24T19:00:58.607ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10052024-10-24T19:00:58.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10062024-10-24T19:00:58.609ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 75.954771ms iteration = 4 status = {"nsuccess":5}
10072024-10-24T19:00:58.609ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
10082024-10-24T19:00:58.609ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
10092024-10-24T19:00:58.609ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
10102024-10-24T19:00:58.609ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
10112024-10-24T19:00:58.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
10122024-10-24T19:00:58.610ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10132024-10-24T19:00:58.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
10142024-10-24T19:00:58.613ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
10152024-10-24T19:00:58.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
10162024-10-24T19:00:58.620ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10172024-10-24T19:00:58.621ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
10182024-10-24T19:00:58.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
10192024-10-24T19:00:58.623ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
10202024-10-24T19:00:58.623ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
10212024-10-24T19:00:58.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
10222024-10-24T19:00:58.631ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
10232024-10-24T19:00:58.631ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
10242024-10-24T19:00:58.631ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 97.899418ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
10252024-10-24T19:00:58.640ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 107.276903ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
10262024-10-24T19:00:58.642ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
10272024-10-24T19:00:58.642ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
10282024-10-24T19:00:58.642ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 108.961339ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
10292024-10-24T19:00:58.648ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
10302024-10-24T19:00:58.648ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 6ae7917d-db6c-4390-ad36-16f7cdab058b dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
10312024-10-24T19:00:58.648ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
10322024-10-24T19:00:58.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
10332024-10-24T19:00:58.651ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10342024-10-24T19:00:58.653ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
10352024-10-24T19:00:58.653ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
10362024-10-24T19:00:58.653ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
10372024-10-24T19:00:58.653ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
10382024-10-24T19:00:58.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
10392024-10-24T19:00:58.654ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
10402024-10-24T19:00:58.654ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
10412024-10-24T19:00:58.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
10422024-10-24T19:00:58.654ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10432024-10-24T19:00:58.658ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
10442024-10-24T19:00:58.658ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
10452024-10-24T19:00:58.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
10462024-10-24T19:00:58.663ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
10472024-10-24T19:00:58.663ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10482024-10-24T19:00:58.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
10492024-10-24T19:00:58.664ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 6ae7917d-db6c-4390-ad36-16f7cdab058b dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
10502024-10-24T19:00:58.664ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
10512024-10-24T19:00:58.664ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-10-24 18:55:00.465937 UTC dns_group = internal generation = 1
10522024-10-24T19:00:58.664ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 131.503097ms iteration = 7 status = {"generation":1}
10532024-10-24T19:00:58.667ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10542024-10-24T19:00:58.668ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8ed5384f-0099-459e-a18a-fdd93abd3452, lookup_type: ById(8ed5384f-0099-459e-a18a-fdd93abd3452) } result = Ok(())
10552024-10-24T19:00:58.668ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10562024-10-24T19:00:58.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10572024-10-24T19:00:58.669ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
10582024-10-24T19:00:58.669ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
10592024-10-24T19:00:58.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
10602024-10-24T19:00:58.671ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 138.054888ms iteration = 13 status = 0
10612024-10-24T19:00:58.671ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
10622024-10-24T19:00:58.680ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10632024-10-24T19:00:58.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10642024-10-24T19:00:58.683ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1113 zone_address = fd00:1122:3344:101::2
10652024-10-24T19:00:58.683ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
10662024-10-24T19:00:58.683ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "98ccba27-0318-4b09-820b-1e5f38143c8d", "content-length": "26", "date": "Thu, 24 Oct 2024 19:00:58 GMT"} })
10672024-10-24T19:00:58.683ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1118 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
10682024-10-24T19:00:58.685ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1150 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
10692024-10-24T19:00:58.716ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
10702024-10-24T19:00:58.716ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 182.704086ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
10712024-10-24T19:00:58.719ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1113 zone_address = fd00:1122:3344:101::2
10722024-10-24T19:00:58.719ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
10732024-10-24T19:00:58.720ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc61ed0c-93e5-4495-8d8f-debee7c30d98", "content-length": "26", "date": "Thu, 24 Oct 2024 19:00:58 GMT"} })
10742024-10-24T19:00:58.720ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1118 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
10752024-10-24T19:00:58.721ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
10762024-10-24T19:00:58.722ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1150 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
10772024-10-24T19:00:58.722ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
10782024-10-24T19:00:58.722ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 40d8768c-5b67-41c8-8a5f-c7782dbfc898 dns_zone_name = oxide.test found_so_far = 0 version = 2
10792024-10-24T19:00:58.722ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
10802024-10-24T19:00:58.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
10812024-10-24T19:00:58.725ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10822024-10-24T19:00:58.730ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
10832024-10-24T19:00:58.730ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
10842024-10-24T19:00:58.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
10852024-10-24T19:00:58.731ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-10-24T18:54:56.514007Z, time_modified: 2024-10-24T18:54:56.514007Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 68627db6-53a8-4390-a3e6-e94f65d72ce7, db_silo: Silo { identity: SiloIdentity { id: 68627db6-53a8-4390-a3e6-e94f65d72ce7, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-24T18:55:01.468978Z, time_modified: 2024-10-24T18:55:01.468978Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "1c746763ac1d0b5e2ef2147ce9044dbc34dc4c4b966a58bca0aa0568eb6d1351" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 68627db6-53a8-4390-a3e6-e94f65d72ce7, db_silo: Silo { identity: SiloIdentity { id: 68627db6-53a8-4390-a3e6-e94f65d72ce7, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-24T18:55:01.468978Z, time_modified: 2024-10-24T18:55:01.468978Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "1c746763ac1d0b5e2ef2147ce9044dbc34dc4c4b966a58bca0aa0568eb6d1351" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
10862024-10-24T19:00:58.731ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 198.465079ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"68627db6-53a8-4390-a3e6-e94f65d72ce7","tls_certs":["1c746763ac1d0b5e2ef2147ce9044dbc34dc4c4b966a58bca0aa0568eb6d1351"]}},"default_endpoint":{"silo_id":"68627db6-53a8-4390-a3e6-e94f65d72ce7","tls_certs":["1c746763ac1d0b5e2ef2147ce9044dbc34dc4c4b966a58bca0aa0568eb6d1351"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
10872024-10-24T19:00:58.733ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 200.208867ms iteration = 15 status = {"physical_disks_added":0}
10882024-10-24T19:00:58.734ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 40d8768c-5b67-41c8-8a5f-c7782dbfc898 dns_zone_name = oxide.test found_so_far = 1 version = 2
10892024-10-24T19:00:58.735ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
10902024-10-24T19:00:58.735ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-10-24 18:55:01.522538 UTC dns_group = external generation = 2
10912024-10-24T19:00:58.735ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 202.309859ms iteration = 7 status = {"generation":2}
10922024-10-24T19:00:58.805ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10932024-10-24T19:00:58.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10942024-10-24T19:00:58.806ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = ba6a7b8d-59b8-45bd-971e-c05161e4b4e3 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
10952024-10-24T19:00:58.806ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10962024-10-24T19:00:58.806ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = ba6a7b8d-59b8-45bd-971e-c05161e4b4e3 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
10972024-10-24T19:00:58.808ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
10982024-10-24T19:00:58.808ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10992024-10-24T19:00:58.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11002024-10-24T19:00:58.808ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2670 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = ba6a7b8d-59b8-45bd-971e-c05161e4b4e3 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
11012024-10-24T19:00:58.858ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
11022024-10-24T19:00:58.858ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "96725ca7-e599-45dc-acc0-ec3c10229078", "content-length": "2", "date": "Thu, 24 Oct 2024 19:00:58 GMT"} })
11032024-10-24T19:00:58.858ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
11042024-10-24T19:00:58.863ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
11052024-10-24T19:00:58.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
11062024-10-24T19:00:58.878ZINFOnexus (BackgroundTasks): VPC route manager sled 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
11072024-10-24T19:00:58.878ZDEBGnexus (BackgroundTasks): client request SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
11082024-10-24T19:00:58.879ZDEBGnexus (BackgroundTasks): client response SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "26c23fb7-10e9-44c4-9948-6f074cdc39c2", "content-length": "372", "date": "Thu, 24 Oct 2024 19:00:58 GMT"} })
11092024-10-24T19:00:58.879ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11102024-10-24T19:00:58.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11112024-10-24T19:00:58.881ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11122024-10-24T19:00:58.881ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 349.480607ms iteration = 13 status = {}
11132024-10-24T19:00:58.882ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 350.070156ms iteration = 13 status = null
11142024-10-24T19:00:58.883ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
11152024-10-24T19:00:58.883ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11162024-10-24T19:00:58.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11172024-10-24T19:00:58.928ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1113 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 zone_address = fd00:1122:3344:101::2
11182024-10-24T19:00:58.928ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11192024-10-24T19:00:58.929ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "58582fff-492f-49c9-a7fa-374b53c9cae9", "content-length": "26", "date": "Thu, 24 Oct 2024 19:00:58 GMT"} })
11202024-10-24T19:00:58.929ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1118 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11212024-10-24T19:00:58.930ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1150 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674
11222024-10-24T19:00:58.935ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
11232024-10-24T19:00:58.935ZDEBGnexus (BackgroundTasks): client request SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
11242024-10-24T19:00:58.936ZDEBGnexus (BackgroundTasks): client response SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "43ad3c15-26e2-4c62-920a-51458bdb7eb3", "date": "Thu, 24 Oct 2024 19:00:58 GMT"} })
11252024-10-24T19:00:58.936ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11262024-10-24T19:00:58.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11272024-10-24T19:00:58.939ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11282024-10-24T19:00:58.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11292024-10-24T19:00:58.942ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11302024-10-24T19:00:58.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11312024-10-24T19:00:58.944ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
11322024-10-24T19:00:58.945ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "295a0d62-b5ee-4c4e-a803-0431c275cf77", "date": "Thu, 24 Oct 2024 19:00:58 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
11332024-10-24T19:00:58.945ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
11342024-10-24T19:00:58.946ZINFOnexus (BackgroundTasks): VPC route manager sled 8ed5384f-0099-459e-a18a-fdd93abd3452 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
11352024-10-24T19:00:58.946ZDEBGnexus (BackgroundTasks): client request SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
11362024-10-24T19:00:58.946ZDEBGnexus (BackgroundTasks): client response SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e742f2bd-f02d-4952-a3cf-9a99042165b2", "date": "Thu, 24 Oct 2024 19:00:58 GMT"} })
11372024-10-24T19:00:58.947ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "e1ce8ffc-d3fa-4084-8e5a-7db21177c899", "date": "Thu, 24 Oct 2024 19:00:58 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
11382024-10-24T19:00:58.947ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
11392024-10-24T19:00:58.949ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 415.994092ms iteration = 14 status = {}
11402024-10-24T19:00:58.950ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
11412024-10-24T19:00:58.950ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 418.178336ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
11422024-10-24T19:00:58.959ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
11432024-10-24T19:00:58.959ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "d5222dbb-47b0-4877-89f1-1039ee3a22fc", "date": "Thu, 24 Oct 2024 19:00:58 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
11442024-10-24T19:00:58.959ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
11452024-10-24T19:00:58.961ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "494a020f-e3ea-426d-93a1-6fec9f3f5416", "date": "Thu, 24 Oct 2024 19:00:58 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
11462024-10-24T19:00:58.961ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
11472024-10-24T19:00:58.962ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "e322774b-55b5-47bd-84e4-4b81cb72a704", "date": "Thu, 24 Oct 2024 19:00:58 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
11482024-10-24T19:00:58.962ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
11492024-10-24T19:00:58.964ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
11502024-10-24T19:00:58.964ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 431.720435ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
11512024-10-24T19:00:59.032ZDEBGnexus (BackgroundTasks): client request SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
11522024-10-24T19:00:59.032ZDEBGnexus (BackgroundTasks): client response SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a850784-ba7d-4972-8e01-38ba68d47590", "content-length": "691", "date": "Thu, 24 Oct 2024 19:00:58 GMT"} })
11532024-10-24T19:00:59.032ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
11542024-10-24T19:00:59.032ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
11552024-10-24T19:00:59.032ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
11562024-10-24T19:00:59.034ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 500.79219ms iteration = 14 status = {}
11572024-10-24T19:00:59.073ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11582024-10-24T19:00:59.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11592024-10-24T19:00:59.075ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 95766534-d8e7-4baf-bb18-72c7cf344605, rack_id: d6d74c37-fa13-4dad-8a2e-066574b53674, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(d796208a-628d-40ec-83c5-b72b8cbc0e00) } rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 switch_location = Switch0
11602024-10-24T19:00:59.075ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11612024-10-24T19:00:59.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11622024-10-24T19:00:59.083ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
11632024-10-24T19:00:59.083ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "7698faab-4d0c-452a-9e2e-b3ecfce69c54", "content-length": "121", "date": "Thu, 24 Oct 2024 19:00:58 GMT"} })
11642024-10-24T19:00:59.083ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
11652024-10-24T19:00:59.083ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = d796208a-628d-40ec-83c5-b72b8cbc0e00
11662024-10-24T19:00:59.084ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
11672024-10-24T19:00:59.084ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
11682024-10-24T19:00:59.084ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
11692024-10-24T19:00:59.084ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
11702024-10-24T19:00:59.084ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
11712024-10-24T19:00:59.084ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
11722024-10-24T19:00:59.084ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
11732024-10-24T19:00:59.084ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
11742024-10-24T19:00:59.084ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674
11752024-10-24T19:00:59.084ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11762024-10-24T19:00:59.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11772024-10-24T19:00:59.087ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
11782024-10-24T19:00:59.087ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb1d764e-bb5a-4354-8b43-2f8668045dcc", "content-length": "2", "date": "Thu, 24 Oct 2024 19:00:58 GMT"} })
11792024-10-24T19:00:59.087ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
11802024-10-24T19:00:59.087ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc710cec-3839-4521-813a-392f89f7e104", "content-length": "52", "date": "Thu, 24 Oct 2024 19:00:58 GMT"} })
11812024-10-24T19:00:59.087ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 switch_location = Switch0
11822024-10-24T19:00:59.087ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
11832024-10-24T19:00:59.186ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "8c6fdc7d-70d3-4b4a-9445-3388eea913e3", "date": "Thu, 24 Oct 2024 19:00:58 GMT"} })
11842024-10-24T19:00:59.186ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 switch = Switch0
11852024-10-24T19:00:59.186ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
11862024-10-24T19:00:59.187ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "eaf4f26f-b880-4828-a5fd-12d4ca4ca09a", "content-length": "669", "date": "Thu, 24 Oct 2024 19:00:59 GMT"} })
11872024-10-24T19:00:59.187ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11882024-10-24T19:00:59.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11892024-10-24T19:00:59.191ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11902024-10-24T19:00:59.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11912024-10-24T19:00:59.194ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11922024-10-24T19:00:59.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11932024-10-24T19:00:59.196ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11942024-10-24T19:00:59.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11952024-10-24T19:00:59.203ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 669.773505ms iteration = 13 status = {}
11962024-10-24T19:00:59.332ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 513 local_addr = [fd00:1122:3344:101::b]:60338 method = GET remote_addr = [fd00:1122:3344:101::d]:39079 req_id = e3dca739-2d33-46f2-9b6d-5595cdb26e30 response_code = 200 uri = /51c1446e-49e7-4598-8832-f33ccdf3c076
11972024-10-24T19:00:59.335ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
11982024-10-24T19:00:59.335ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
11992024-10-24T19:00:59.365ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
12002024-10-24T19:00:59.366ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:58707
12012024-10-24T19:00:59.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:58707 req_id = a0c39fe5-e88e-4362-b712-1fb032357895 roles = RoleSet { roles: {} } uri = /metrics/producers
12022024-10-24T19:00:59.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:58707 req_id = a0c39fe5-e88e-4362-b712-1fb032357895 resource = Database result = Ok(()) uri = /metrics/producers
12032024-10-24T19:00:59.477ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:337 id = d3774998-58a6-4b89-8d53-ad0f914d458d
12042024-10-24T19:00:59.477ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = d3774998-58a6-4b89-8d53-ad0f914d458d uri = http://[fd00:1122:3344:101::d]:12223/producers
12052024-10-24T19:00:59.477ZDEBGnexus: client response oximeter-collector = d3774998-58a6-4b89-8d53-ad0f914d458d result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "15bf4185-b921-458d-bf0d-6d6c89530095", "date": "Thu, 24 Oct 2024 19:00:59 GMT"} })
12062024-10-24T19:00:59.477ZINFOnexus: assigned collector to new producer collector_id = d3774998-58a6-4b89-8d53-ad0f914d458d file = nexus/src/app/oximeter.rs:144 producer_id = 51c1446e-49e7-4598-8832-f33ccdf3c076
12072024-10-24T19:00:59.479ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 113160 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:58707 req_id = a0c39fe5-e88e-4362-b712-1fb032357895 response_code = 201 uri = /metrics/producers
12082024-10-24T19:00:59.479ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "a0c39fe5-e88e-4362-b712-1fb032357895", "content-length": "41", "date": "Thu, 24 Oct 2024 19:00:59 GMT"} })
12092024-10-24T19:00:59.480ZDEBGnexus (producer-registration-task): registered with nexus successfully
12102024-10-24T19:00:59.480ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
12112024-10-24T19:00:59.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = d5975288-4ae6-47c7-a37a-09170eafefe4 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
12122024-10-24T19:00:59.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = d5975288-4ae6-47c7-a37a-09170eafefe4 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
12132024-10-24T19:00:59.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1693 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = d5975288-4ae6-47c7-a37a-09170eafefe4 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
12142024-10-24T19:01:00.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 656d32d8-3e6c-4686-8ae8-cd588407d5af roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
12152024-10-24T19:01:00.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 656d32d8-3e6c-4686-8ae8-cd588407d5af resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
12162024-10-24T19:01:00.858ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2333 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 656d32d8-3e6c-4686-8ae8-cd588407d5af response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
12172024-10-24T19:01:01.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 238821e1-e6d3-4917-92a7-26f99b4ce41a roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
12182024-10-24T19:01:01.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 238821e1-e6d3-4917-92a7-26f99b4ce41a resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
12192024-10-24T19:01:01.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2535 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 238821e1-e6d3-4917-92a7-26f99b4ce41a response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
12202024-10-24T19:01:02.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = dccaf34d-8747-4821-833d-65ec93780ec2 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
12212024-10-24T19:01:02.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = dccaf34d-8747-4821-833d-65ec93780ec2 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
12222024-10-24T19:01:02.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1999 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = dccaf34d-8747-4821-833d-65ec93780ec2 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
12232024-10-24T19:01:03.923ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 64ee63e3-b9a0-4ef8-9ef1-dcf1297d6c10 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
12242024-10-24T19:01:03.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 64ee63e3-b9a0-4ef8-9ef1-dcf1297d6c10 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
12252024-10-24T19:01:03.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2454 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 64ee63e3-b9a0-4ef8-9ef1-dcf1297d6c10 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
12262024-10-24T19:01:04.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = ad2903c5-c9af-4c68-bba5-a8af1482d297 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
12272024-10-24T19:01:04.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = ad2903c5-c9af-4c68-bba5-a8af1482d297 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
12282024-10-24T19:01:04.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1740 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = ad2903c5-c9af-4c68-bba5-a8af1482d297 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
12292024-10-24T19:01:05.966ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = cdb31762-da97-484b-9e3e-794bac83e60c roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
12302024-10-24T19:01:05.966ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = cdb31762-da97-484b-9e3e-794bac83e60c resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
12312024-10-24T19:01:05.968ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2301 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = cdb31762-da97-484b-9e3e-794bac83e60c response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
12322024-10-24T19:01:06.988ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 4e7797c3-b848-4504-ace1-5c612b7bd15d roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
12332024-10-24T19:01:06.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 4e7797c3-b848-4504-ace1-5c612b7bd15d resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
12342024-10-24T19:01:06.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2386 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 4e7797c3-b848-4504-ace1-5c612b7bd15d response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
12352024-10-24T19:01:08.011ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 6f4ee517-3e46-4975-92e7-49794f0a19a8 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
12362024-10-24T19:01:08.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 6f4ee517-3e46-4975-92e7-49794f0a19a8 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
12372024-10-24T19:01:08.014ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2537 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 6f4ee517-3e46-4975-92e7-49794f0a19a8 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
12382024-10-24T19:01:08.533ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
12392024-10-24T19:01:08.533ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
12402024-10-24T19:01:08.533ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12412024-10-24T19:01:08.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12422024-10-24T19:01:08.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12432024-10-24T19:01:08.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12442024-10-24T19:01:08.535ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12452024-10-24T19:01:08.535ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12462024-10-24T19:01:08.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12472024-10-24T19:01:08.537ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.364667ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12482024-10-24T19:01:08.537ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12492024-10-24T19:01:08.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12502024-10-24T19:01:08.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12512024-10-24T19:01:08.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12522024-10-24T19:01:08.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12532024-10-24T19:01:08.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12542024-10-24T19:01:08.543ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: fbb59198-7d6e-40d8-9b05-3fd3707f9c53, lookup_type: ById(fbb59198-7d6e-40d8-9b05-3fd3707f9c53) } result = Ok(())
12552024-10-24T19:01:08.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12562024-10-24T19:01:08.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12572024-10-24T19:01:08.551ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = fbb59198-7d6e-40d8-9b05-3fd3707f9c53 original_time_created = 2024-10-24 18:54:46.689131 UTC target_id = fbb59198-7d6e-40d8-9b05-3fd3707f9c53 time_created = 2024-10-24 18:54:46.689131 UTC
12582024-10-24T19:01:08.551ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.243211ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"fbb59198-7d6e-40d8-9b05-3fd3707f9c53","time_created":"2024-10-24T18:54:46.689131Z"}
12592024-10-24T19:01:09.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = a8c306d2-ee86-4df9-9716-b14fe7df59cf roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
12602024-10-24T19:01:09.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = a8c306d2-ee86-4df9-9716-b14fe7df59cf resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
12612024-10-24T19:01:09.037ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1919 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = a8c306d2-ee86-4df9-9716-b14fe7df59cf response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
12622024-10-24T19:01:09.479ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 486 local_addr = [fd00:1122:3344:101::b]:60338 method = GET remote_addr = [fd00:1122:3344:101::d]:39079 req_id = d864dafa-a171-4750-88ac-91ee61c35861 response_code = 200 uri = /51c1446e-49e7-4598-8832-f33ccdf3c076
12632024-10-24T19:01:10.059ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 25fbef0e-b35c-4d5f-ac48-282e171c148e roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
12642024-10-24T19:01:10.059ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 25fbef0e-b35c-4d5f-ac48-282e171c148e resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
12652024-10-24T19:01:10.061ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2442 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 25fbef0e-b35c-4d5f-ac48-282e171c148e response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
12662024-10-24T19:01:11.081ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 8c1be8a1-70cc-4af5-8f35-54ba15697858 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
12672024-10-24T19:01:11.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 8c1be8a1-70cc-4af5-8f35-54ba15697858 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
12682024-10-24T19:01:11.084ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2193 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 8c1be8a1-70cc-4af5-8f35-54ba15697858 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
12692024-10-24T19:01:12.105ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 6a53747e-8558-4aa8-9658-a872debdf084 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
12702024-10-24T19:01:12.105ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 6a53747e-8558-4aa8-9658-a872debdf084 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
12712024-10-24T19:01:12.107ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2470 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 6a53747e-8558-4aa8-9658-a872debdf084 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
12722024-10-24T19:01:13.127ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = c5fb1abd-a77f-423c-b98b-0562398454fd roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
12732024-10-24T19:01:13.128ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = c5fb1abd-a77f-423c-b98b-0562398454fd resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
12742024-10-24T19:01:13.130ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2706 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = c5fb1abd-a77f-423c-b98b-0562398454fd response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
12752024-10-24T19:01:14.150ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = d1b83050-8c65-44a6-8ba7-240f7f4850d4 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
12762024-10-24T19:01:14.150ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = d1b83050-8c65-44a6-8ba7-240f7f4850d4 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
12772024-10-24T19:01:14.151ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1692 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = d1b83050-8c65-44a6-8ba7-240f7f4850d4 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
12782024-10-24T19:01:15.171ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 4ded3bd0-1ab3-43a6-9c52-542fcb1d9f08 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
12792024-10-24T19:01:15.171ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 4ded3bd0-1ab3-43a6-9c52-542fcb1d9f08 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
12802024-10-24T19:01:15.173ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2170 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 4ded3bd0-1ab3-43a6-9c52-542fcb1d9f08 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
12812024-10-24T19:01:16.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 4ec6b166-04ef-4dd9-864e-7aa510209edf roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
12822024-10-24T19:01:16.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 4ec6b166-04ef-4dd9-864e-7aa510209edf resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
12832024-10-24T19:01:16.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2273 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 4ec6b166-04ef-4dd9-864e-7aa510209edf response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
12842024-10-24T19:01:17.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = dd1442ac-d790-40aa-9932-413c0ee19ac4 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
12852024-10-24T19:01:17.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = dd1442ac-d790-40aa-9932-413c0ee19ac4 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
12862024-10-24T19:01:17.223ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8422 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = dd1442ac-d790-40aa-9932-413c0ee19ac4 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
12872024-10-24T19:01:18.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 45495cea-8884-4ce4-944a-a43968898a83 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
12882024-10-24T19:01:18.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 45495cea-8884-4ce4-944a-a43968898a83 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
12892024-10-24T19:01:18.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2594 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 45495cea-8884-4ce4-944a-a43968898a83 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
12902024-10-24T19:01:18.533ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
12912024-10-24T19:01:18.533ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
12922024-10-24T19:01:18.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12932024-10-24T19:01:18.533ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12942024-10-24T19:01:18.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12952024-10-24T19:01:18.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12962024-10-24T19:01:18.535ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12972024-10-24T19:01:18.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12982024-10-24T19:01:18.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12992024-10-24T19:01:18.538ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.565121ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
13002024-10-24T19:01:18.539ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
13012024-10-24T19:01:18.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13022024-10-24T19:01:18.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13032024-10-24T19:01:18.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13042024-10-24T19:01:18.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13052024-10-24T19:01:18.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13062024-10-24T19:01:18.546ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: fbb59198-7d6e-40d8-9b05-3fd3707f9c53, lookup_type: ById(fbb59198-7d6e-40d8-9b05-3fd3707f9c53) } result = Ok(())
13072024-10-24T19:01:18.546ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13082024-10-24T19:01:18.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13092024-10-24T19:01:18.554ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = fbb59198-7d6e-40d8-9b05-3fd3707f9c53 original_time_created = 2024-10-24 18:54:46.689131 UTC target_id = fbb59198-7d6e-40d8-9b05-3fd3707f9c53 time_created = 2024-10-24 18:54:46.689131 UTC
13102024-10-24T19:01:18.554ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.131686ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"fbb59198-7d6e-40d8-9b05-3fd3707f9c53","time_created":"2024-10-24T18:54:46.689131Z"}
13112024-10-24T19:01:19.266ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 8204e4aa-9fdc-49c6-886b-c60b0a41b386 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
13122024-10-24T19:01:19.266ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 8204e4aa-9fdc-49c6-886b-c60b0a41b386 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
13132024-10-24T19:01:19.268ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2134 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 8204e4aa-9fdc-49c6-886b-c60b0a41b386 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
13142024-10-24T19:01:19.478ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 552 local_addr = [fd00:1122:3344:101::b]:60338 method = GET remote_addr = [fd00:1122:3344:101::d]:39079 req_id = c9e1235e-fc7f-4c54-8af3-f83a12cf3ac9 response_code = 200 uri = /51c1446e-49e7-4598-8832-f33ccdf3c076
13152024-10-24T19:01:20.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = d73274f0-eb82-4ed8-a512-4e4e2efdc1a3 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
13162024-10-24T19:01:20.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = d73274f0-eb82-4ed8-a512-4e4e2efdc1a3 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
13172024-10-24T19:01:20.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2413 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = d73274f0-eb82-4ed8-a512-4e4e2efdc1a3 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
13182024-10-24T19:01:21.310ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = c54f764d-d336-45c1-9273-426e62d28d80 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
13192024-10-24T19:01:21.311ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = c54f764d-d336-45c1-9273-426e62d28d80 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
13202024-10-24T19:01:21.313ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2712 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = c54f764d-d336-45c1-9273-426e62d28d80 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
13212024-10-24T19:01:22.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = b573d86c-7486-41d4-ad63-1813484594d7 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
13222024-10-24T19:01:22.334ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = b573d86c-7486-41d4-ad63-1813484594d7 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
13232024-10-24T19:01:22.335ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2217 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = b573d86c-7486-41d4-ad63-1813484594d7 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
13242024-10-24T19:01:23.355ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 2b1e9f35-65e0-41a4-9d65-e4b63b023f8f roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
13252024-10-24T19:01:23.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 2b1e9f35-65e0-41a4-9d65-e4b63b023f8f resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
13262024-10-24T19:01:23.357ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1863 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 2b1e9f35-65e0-41a4-9d65-e4b63b023f8f response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
13272024-10-24T19:01:24.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = ef9a9716-b988-40ac-9b3e-258bb6824d84 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
13282024-10-24T19:01:24.379ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = ef9a9716-b988-40ac-9b3e-258bb6824d84 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
13292024-10-24T19:01:24.381ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2473 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = ef9a9716-b988-40ac-9b3e-258bb6824d84 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
13302024-10-24T19:01:25.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 74d6fd9c-b6bf-427e-851f-bb8f3032fc6a roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
13312024-10-24T19:01:25.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 74d6fd9c-b6bf-427e-851f-bb8f3032fc6a resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
13322024-10-24T19:01:25.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2266 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 74d6fd9c-b6bf-427e-851f-bb8f3032fc6a response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
13332024-10-24T19:01:26.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = bd38bfa9-73e2-4761-bfe8-87e07c144e21 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
13342024-10-24T19:01:26.423ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = bd38bfa9-73e2-4761-bfe8-87e07c144e21 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
13352024-10-24T19:01:26.425ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2483 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = bd38bfa9-73e2-4761-bfe8-87e07c144e21 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
13362024-10-24T19:01:27.446ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = ad43219c-857e-43fa-80db-da869908f597 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
13372024-10-24T19:01:27.446ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = ad43219c-857e-43fa-80db-da869908f597 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
13382024-10-24T19:01:27.448ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2388 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = ad43219c-857e-43fa-80db-da869908f597 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
13392024-10-24T19:01:27.489ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59130 req_id = 39e3ff60-c80c-4f2c-975b-8b34956e2e1c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
13402024-10-24T19:01:27.489ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59130 req_id = 39e3ff60-c80c-4f2c-975b-8b34956e2e1c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
13412024-10-24T19:01:27.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3613 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59130 req_id = 39e3ff60-c80c-4f2c-975b-8b34956e2e1c response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
13422024-10-24T19:01:28.471ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 42d59518-6248-417e-a23b-8be6c9aba487 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
13432024-10-24T19:01:28.472ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 42d59518-6248-417e-a23b-8be6c9aba487 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
13442024-10-24T19:01:28.474ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2839 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 42d59518-6248-417e-a23b-8be6c9aba487 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
13452024-10-24T19:01:28.533ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
13462024-10-24T19:01:28.533ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
13472024-10-24T19:01:28.533ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
13482024-10-24T19:01:28.533ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
13492024-10-24T19:01:28.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
13502024-10-24T19:01:28.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
13512024-10-24T19:01:28.534ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
13522024-10-24T19:01:28.534ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
13532024-10-24T19:01:28.534ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
13542024-10-24T19:01:28.534ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
13552024-10-24T19:01:28.534ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13562024-10-24T19:01:28.534ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 6.38\u{b5}s iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
13572024-10-24T19:01:28.534ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13582024-10-24T19:01:28.534ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
13592024-10-24T19:01:28.534ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 2.971\u{b5}s iteration = 14 status = {"errors":[],"records_set_to_done":[]}
13602024-10-24T19:01:28.534ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
13612024-10-24T19:01:28.534ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
13622024-10-24T19:01:28.534ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
13632024-10-24T19:01:28.534ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 3.79\u{b5}s iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
13642024-10-24T19:01:28.534ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
13652024-10-24T19:01:28.534ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
13662024-10-24T19:01:28.534ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
13672024-10-24T19:01:28.534ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13682024-10-24T19:01:28.534ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
13692024-10-24T19:01:28.534ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
13702024-10-24T19:01:28.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13712024-10-24T19:01:28.534ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13722024-10-24T19:01:28.534ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
13732024-10-24T19:01:28.534ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
13742024-10-24T19:01:28.534ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
13752024-10-24T19:01:28.534ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 11.65\u{b5}s iteration = 14 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
13762024-10-24T19:01:28.534ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
13772024-10-24T19:01:28.534ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
13782024-10-24T19:01:28.534ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
13792024-10-24T19:01:28.534ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13802024-10-24T19:01:28.534ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
13812024-10-24T19:01:28.534ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13822024-10-24T19:01:28.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13832024-10-24T19:01:28.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
13842024-10-24T19:01:28.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13852024-10-24T19:01:28.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
13862024-10-24T19:01:28.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13872024-10-24T19:01:28.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13882024-10-24T19:01:28.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
13892024-10-24T19:01:28.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13902024-10-24T19:01:28.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13912024-10-24T19:01:28.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13922024-10-24T19:01:28.536ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8ed5384f-0099-459e-a18a-fdd93abd3452.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8ed5384f-0099-459e-a18a-fdd93abd3452.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3331, tv_nsec: 900845501 } })
13932024-10-24T19:01:28.536ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8ed5384f-0099-459e-a18a-fdd93abd3452.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8ed5384f-0099-459e-a18a-fdd93abd3452.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3331, tv_nsec: 901057284 } })
13942024-10-24T19:01:28.536ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1105
13952024-10-24T19:01:28.536ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1105
13962024-10-24T19:01:28.537ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13972024-10-24T19:01:28.538ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13982024-10-24T19:01:28.538ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13992024-10-24T19:01:28.539ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.489069ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
14002024-10-24T19:01:28.540ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
14012024-10-24T19:01:28.540ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14022024-10-24T19:01:28.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14032024-10-24T19:01:28.540ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
14042024-10-24T19:01:28.540ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
14052024-10-24T19:01:28.540ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
14062024-10-24T19:01:28.540ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14072024-10-24T19:01:28.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
14082024-10-24T19:01:28.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14092024-10-24T19:01:28.542ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14102024-10-24T19:01:28.542ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14112024-10-24T19:01:28.542ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14122024-10-24T19:01:28.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14132024-10-24T19:01:28.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14142024-10-24T19:01:28.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
14152024-10-24T19:01:28.544ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14162024-10-24T19:01:28.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14172024-10-24T19:01:28.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
14182024-10-24T19:01:28.545ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14192024-10-24T19:01:28.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14202024-10-24T19:01:28.546ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14212024-10-24T19:01:28.546ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14222024-10-24T19:01:28.546ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14232024-10-24T19:01:28.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14242024-10-24T19:01:28.546ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8ed5384f-0099-459e-a18a-fdd93abd3452.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8ed5384f-0099-459e-a18a-fdd93abd3452.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3331, tv_nsec: 910951467 } })
14252024-10-24T19:01:28.547ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1105 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674
14262024-10-24T19:01:28.547ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
14272024-10-24T19:01:28.547ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14282024-10-24T19:01:28.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14292024-10-24T19:01:28.548ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14302024-10-24T19:01:28.548ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14312024-10-24T19:01:28.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14322024-10-24T19:01:28.548ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14332024-10-24T19:01:28.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14342024-10-24T19:01:28.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14352024-10-24T19:01:28.549ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14362024-10-24T19:01:28.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14372024-10-24T19:01:28.549ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14382024-10-24T19:01:28.550ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14392024-10-24T19:01:28.551ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
14402024-10-24T19:01:28.551ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14412024-10-24T19:01:28.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14422024-10-24T19:01:28.553ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: fbb59198-7d6e-40d8-9b05-3fd3707f9c53, lookup_type: ById(fbb59198-7d6e-40d8-9b05-3fd3707f9c53) } result = Ok(())
14432024-10-24T19:01:28.553ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14442024-10-24T19:01:28.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14452024-10-24T19:01:28.561ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = fbb59198-7d6e-40d8-9b05-3fd3707f9c53 original_time_created = 2024-10-24 18:54:46.689131 UTC target_id = fbb59198-7d6e-40d8-9b05-3fd3707f9c53 time_created = 2024-10-24 18:54:46.689131 UTC
14462024-10-24T19:01:28.561ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.785793ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"fbb59198-7d6e-40d8-9b05-3fd3707f9c53","time_created":"2024-10-24T18:54:46.689131Z"}
14472024-10-24T19:01:28.562ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14482024-10-24T19:01:28.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14492024-10-24T19:01:28.564ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14502024-10-24T19:01:28.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14512024-10-24T19:01:28.565ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14522024-10-24T19:01:28.569ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8ed5384f-0099-459e-a18a-fdd93abd3452, lookup_type: ById(8ed5384f-0099-459e-a18a-fdd93abd3452) } result = Ok(())
14532024-10-24T19:01:28.569ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14542024-10-24T19:01:28.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14552024-10-24T19:01:28.571ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 37.342206ms iteration = 14 status = 0
14562024-10-24T19:01:28.571ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
14572024-10-24T19:01:28.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
14582024-10-24T19:01:28.574ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 39.660471ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
14592024-10-24T19:01:28.576ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
14602024-10-24T19:01:28.576ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
14612024-10-24T19:01:28.576ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14622024-10-24T19:01:28.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14632024-10-24T19:01:28.579ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 44.502556ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14642024-10-24T19:01:28.584ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
14652024-10-24T19:01:28.584ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 50.158934ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
14662024-10-24T19:01:28.605ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1113 zone_address = fd00:1122:3344:101::2
14672024-10-24T19:01:28.605ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14682024-10-24T19:01:28.605ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d5a86102-6d6e-4825-8a2e-dcc93de9ad99", "content-length": "26", "date": "Thu, 24 Oct 2024 19:01:28 GMT"} })
14692024-10-24T19:01:28.605ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1118 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14702024-10-24T19:01:28.606ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1113 zone_address = fd00:1122:3344:101::2
14712024-10-24T19:01:28.606ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14722024-10-24T19:01:28.606ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "97e12c7f-5230-490a-bbc0-41a4d530680b", "content-length": "26", "date": "Thu, 24 Oct 2024 19:01:28 GMT"} })
14732024-10-24T19:01:28.606ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1118 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14742024-10-24T19:01:28.606ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1150 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
14752024-10-24T19:01:28.607ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
14762024-10-24T19:01:28.607ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
14772024-10-24T19:01:28.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14782024-10-24T19:01:28.607ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1150 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
14792024-10-24T19:01:28.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14802024-10-24T19:01:28.608ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14812024-10-24T19:01:28.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14822024-10-24T19:01:28.610ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14832024-10-24T19:01:28.612ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
14842024-10-24T19:01:28.612ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14852024-10-24T19:01:28.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14862024-10-24T19:01:28.614ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14872024-10-24T19:01:28.615ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
14882024-10-24T19:01:28.615ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14892024-10-24T19:01:28.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14902024-10-24T19:01:28.627ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1113 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 zone_address = fd00:1122:3344:101::2
14912024-10-24T19:01:28.627ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14922024-10-24T19:01:28.627ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "537f969c-f536-417a-835c-f2858bd5609b", "content-length": "26", "date": "Thu, 24 Oct 2024 19:01:28 GMT"} })
14932024-10-24T19:01:28.627ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1118 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14942024-10-24T19:01:28.629ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1150 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674
14952024-10-24T19:01:28.636ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
14962024-10-24T19:01:28.636ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
14972024-10-24T19:01:28.636ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 102.276107ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
14982024-10-24T19:01:28.637ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 103.360424ms iteration = 16 status = {"physical_disks_added":0}
14992024-10-24T19:01:28.721ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 188.231981ms iteration = 14 status = {}
15002024-10-24T19:01:28.795ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
15012024-10-24T19:01:28.796ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "14edabdf-3966-4c32-bc8c-c0ae1e340432", "content-length": "2", "date": "Thu, 24 Oct 2024 19:01:28 GMT"} })
15022024-10-24T19:01:28.798ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
15032024-10-24T19:01:28.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
15042024-10-24T19:01:28.803ZINFOnexus (BackgroundTasks): VPC route manager sled 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
15052024-10-24T19:01:28.803ZDEBGnexus (BackgroundTasks): client request SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
15062024-10-24T19:01:28.803ZDEBGnexus (BackgroundTasks): client response SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "58105fba-61c9-499c-8674-0cba62d07dd4", "content-length": "372", "date": "Thu, 24 Oct 2024 19:01:28 GMT"} })
15072024-10-24T19:01:28.803ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15082024-10-24T19:01:28.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15092024-10-24T19:01:28.806ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 272.934667ms iteration = 14 status = null
15102024-10-24T19:01:28.848ZDEBGnexus (BackgroundTasks): client request SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
15112024-10-24T19:01:28.848ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15122024-10-24T19:01:28.848ZDEBGnexus (BackgroundTasks): client response SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "aeb6e2e5-a140-4057-adc8-2cb64d4e3e56", "content-length": "691", "date": "Thu, 24 Oct 2024 19:01:28 GMT"} })
15132024-10-24T19:01:28.848ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
15142024-10-24T19:01:28.848ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
15152024-10-24T19:01:28.848ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
15162024-10-24T19:01:28.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15172024-10-24T19:01:28.849ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 315.208989ms iteration = 15 status = {}
15182024-10-24T19:01:28.852ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 95766534-d8e7-4baf-bb18-72c7cf344605, rack_id: d6d74c37-fa13-4dad-8a2e-066574b53674, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(d796208a-628d-40ec-83c5-b72b8cbc0e00) } rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 switch_location = Switch0
15192024-10-24T19:01:28.852ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15202024-10-24T19:01:28.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15212024-10-24T19:01:28.867ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
15222024-10-24T19:01:28.867ZDEBGnexus (BackgroundTasks): client request SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
15232024-10-24T19:01:28.867ZDEBGnexus (BackgroundTasks): client response SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "8beb46d0-d521-402b-8cc6-95e1f0d1a62b", "date": "Thu, 24 Oct 2024 19:01:28 GMT"} })
15242024-10-24T19:01:28.867ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15252024-10-24T19:01:28.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15262024-10-24T19:01:28.869ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
15272024-10-24T19:01:28.869ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "421b8b12-d283-442b-b119-8bb27bba0ab1", "content-length": "121", "date": "Thu, 24 Oct 2024 19:01:28 GMT"} })
15282024-10-24T19:01:28.869ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
15292024-10-24T19:01:28.869ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = d796208a-628d-40ec-83c5-b72b8cbc0e00
15302024-10-24T19:01:28.870ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
15312024-10-24T19:01:28.870ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
15322024-10-24T19:01:28.870ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15332024-10-24T19:01:28.870ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15342024-10-24T19:01:28.870ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15352024-10-24T19:01:28.870ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
15362024-10-24T19:01:28.870ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15372024-10-24T19:01:28.870ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
15382024-10-24T19:01:28.870ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674
15392024-10-24T19:01:28.870ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15402024-10-24T19:01:28.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15412024-10-24T19:01:28.870ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15422024-10-24T19:01:28.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15432024-10-24T19:01:28.872ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
15442024-10-24T19:01:28.873ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "1bbba17f-79e3-482b-945c-1b1fafd26eb2", "content-length": "2", "date": "Thu, 24 Oct 2024 19:01:28 GMT"} })
15452024-10-24T19:01:28.873ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
15462024-10-24T19:01:28.873ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f5888a8c-d013-43e2-b591-c9ecb505ae32", "content-length": "52", "date": "Thu, 24 Oct 2024 19:01:28 GMT"} })
15472024-10-24T19:01:28.873ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 switch_location = Switch0
15482024-10-24T19:01:28.873ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
15492024-10-24T19:01:28.874ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15502024-10-24T19:01:28.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15512024-10-24T19:01:28.877ZINFOnexus (BackgroundTasks): VPC route manager sled 8ed5384f-0099-459e-a18a-fdd93abd3452 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
15522024-10-24T19:01:28.877ZDEBGnexus (BackgroundTasks): client request SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
15532024-10-24T19:01:28.982ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "1fd4624c-27d6-48e1-b2b9-b438b4c414ef", "date": "Thu, 24 Oct 2024 19:01:28 GMT"} })
15542024-10-24T19:01:28.982ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 switch = Switch0
15552024-10-24T19:01:28.982ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
15562024-10-24T19:01:28.982ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "baa5b012-3b2c-460e-a204-9561f416b11d", "content-length": "669", "date": "Thu, 24 Oct 2024 19:01:28 GMT"} })
15572024-10-24T19:01:28.982ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15582024-10-24T19:01:28.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15592024-10-24T19:01:28.983ZDEBGnexus (BackgroundTasks): client response SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "32a8690c-fba3-4a05-92db-44a604b4300b", "date": "Thu, 24 Oct 2024 19:01:28 GMT"} })
15602024-10-24T19:01:28.984ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 450.516704ms iteration = 15 status = {}
15612024-10-24T19:01:28.986ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15622024-10-24T19:01:28.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15632024-10-24T19:01:28.990ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15642024-10-24T19:01:28.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15652024-10-24T19:01:28.992ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15662024-10-24T19:01:28.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15672024-10-24T19:01:28.998ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 464.50737ms iteration = 14 status = {}
15682024-10-24T19:01:29.478ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 593 local_addr = [fd00:1122:3344:101::b]:60338 method = GET remote_addr = [fd00:1122:3344:101::d]:39079 req_id = 15cdd691-44ce-4ffd-8fac-bd3c0de6bf9b response_code = 200 uri = /51c1446e-49e7-4598-8832-f33ccdf3c076
15692024-10-24T19:01:29.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 2bef744e-c635-43cc-9ef2-192ef7d4dd72 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
15702024-10-24T19:01:29.494ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 2bef744e-c635-43cc-9ef2-192ef7d4dd72 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
15712024-10-24T19:01:29.496ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2572 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 2bef744e-c635-43cc-9ef2-192ef7d4dd72 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
15722024-10-24T19:01:30.517ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = fd1ebc67-2b25-4d4c-8480-bf952836aa8a roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
15732024-10-24T19:01:30.517ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = fd1ebc67-2b25-4d4c-8480-bf952836aa8a resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
15742024-10-24T19:01:30.519ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2199 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = fd1ebc67-2b25-4d4c-8480-bf952836aa8a response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
15752024-10-24T19:01:31.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = ac563e8e-2d33-4e59-b21c-ebf42f248c57 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
15762024-10-24T19:01:31.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = ac563e8e-2d33-4e59-b21c-ebf42f248c57 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
15772024-10-24T19:01:31.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2083 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = ac563e8e-2d33-4e59-b21c-ebf42f248c57 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
15782024-10-24T19:01:32.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 177a1416-fb92-4c03-9f07-8e5163635d23 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
15792024-10-24T19:01:32.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 177a1416-fb92-4c03-9f07-8e5163635d23 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
15802024-10-24T19:01:32.564ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2889 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 177a1416-fb92-4c03-9f07-8e5163635d23 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
15812024-10-24T19:01:33.583ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 787f4652-c6f7-4c3e-97cb-c223c4c17ff2 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
15822024-10-24T19:01:33.584ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 787f4652-c6f7-4c3e-97cb-c223c4c17ff2 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
15832024-10-24T19:01:33.586ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3055 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 787f4652-c6f7-4c3e-97cb-c223c4c17ff2 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
15842024-10-24T19:01:34.606ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 9bfddb7a-4fad-43d4-bfe6-8f4152760999 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
15852024-10-24T19:01:34.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 9bfddb7a-4fad-43d4-bfe6-8f4152760999 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
15862024-10-24T19:01:34.608ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1987 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 9bfddb7a-4fad-43d4-bfe6-8f4152760999 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
15872024-10-24T19:01:35.629ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 8bb23c01-25df-4557-8a21-40ebfe0000fa roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
15882024-10-24T19:01:35.630ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 8bb23c01-25df-4557-8a21-40ebfe0000fa resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
15892024-10-24T19:01:35.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2480 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 8bb23c01-25df-4557-8a21-40ebfe0000fa response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
15902024-10-24T19:01:36.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 8794cc84-6c33-48f1-b732-4c65dff93c36 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
15912024-10-24T19:01:36.653ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 8794cc84-6c33-48f1-b732-4c65dff93c36 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
15922024-10-24T19:01:36.655ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2757 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 8794cc84-6c33-48f1-b732-4c65dff93c36 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
15932024-10-24T19:01:37.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = ceb634fe-0c0f-49e3-9bcd-dd7b33bd6e4e roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
15942024-10-24T19:01:37.676ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = ceb634fe-0c0f-49e3-9bcd-dd7b33bd6e4e resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
15952024-10-24T19:01:37.678ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2415 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = ceb634fe-0c0f-49e3-9bcd-dd7b33bd6e4e response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
15962024-10-24T19:01:38.534ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
15972024-10-24T19:01:38.534ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
15982024-10-24T19:01:38.534ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15992024-10-24T19:01:38.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16002024-10-24T19:01:38.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16012024-10-24T19:01:38.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16022024-10-24T19:01:38.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16032024-10-24T19:01:38.539ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
16042024-10-24T19:01:38.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16052024-10-24T19:01:38.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16062024-10-24T19:01:38.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16072024-10-24T19:01:38.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16082024-10-24T19:01:38.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16092024-10-24T19:01:38.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: fbb59198-7d6e-40d8-9b05-3fd3707f9c53, lookup_type: ById(fbb59198-7d6e-40d8-9b05-3fd3707f9c53) } result = Ok(())
16102024-10-24T19:01:38.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16112024-10-24T19:01:38.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16122024-10-24T19:01:38.554ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = fbb59198-7d6e-40d8-9b05-3fd3707f9c53 original_time_created = 2024-10-24 18:54:46.689131 UTC target_id = fbb59198-7d6e-40d8-9b05-3fd3707f9c53 time_created = 2024-10-24 18:54:46.689131 UTC
16132024-10-24T19:01:38.554ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.518211ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"fbb59198-7d6e-40d8-9b05-3fd3707f9c53","time_created":"2024-10-24T18:54:46.689131Z"}
16142024-10-24T19:01:38.563ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16152024-10-24T19:01:38.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16162024-10-24T19:01:38.590ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.232436ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
16172024-10-24T19:01:38.699ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 1c60a7ce-a755-40f7-baa4-f8989df59345 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
16182024-10-24T19:01:38.700ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 1c60a7ce-a755-40f7-baa4-f8989df59345 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
16192024-10-24T19:01:38.701ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1807 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 1c60a7ce-a755-40f7-baa4-f8989df59345 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
16202024-10-24T19:01:39.479ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 650 local_addr = [fd00:1122:3344:101::b]:60338 method = GET remote_addr = [fd00:1122:3344:101::d]:39079 req_id = 1c3f7f84-3899-4680-9d7e-877c15b33976 response_code = 200 uri = /51c1446e-49e7-4598-8832-f33ccdf3c076
16212024-10-24T19:01:39.720ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = f631735e-5d1b-4b13-bd49-b3ed1d4cf065 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
16222024-10-24T19:01:39.721ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = f631735e-5d1b-4b13-bd49-b3ed1d4cf065 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
16232024-10-24T19:01:39.723ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2321 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = f631735e-5d1b-4b13-bd49-b3ed1d4cf065 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
16242024-10-24T19:01:40.743ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = a978f526-6285-418e-a51d-d2ffcbd51e69 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
16252024-10-24T19:01:40.743ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = a978f526-6285-418e-a51d-d2ffcbd51e69 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
16262024-10-24T19:01:40.745ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2543 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = a978f526-6285-418e-a51d-d2ffcbd51e69 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
16272024-10-24T19:01:41.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 068b40e9-2843-4871-a240-8016e684c641 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
16282024-10-24T19:01:41.766ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 068b40e9-2843-4871-a240-8016e684c641 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
16292024-10-24T19:01:41.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2219 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 068b40e9-2843-4871-a240-8016e684c641 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
16302024-10-24T19:01:42.788ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = eda4661c-3848-48db-a9e5-15723fc2b4fd roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
16312024-10-24T19:01:42.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = eda4661c-3848-48db-a9e5-15723fc2b4fd resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
16322024-10-24T19:01:42.790ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1926 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = eda4661c-3848-48db-a9e5-15723fc2b4fd response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
16332024-10-24T19:01:43.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 067dc25e-1d77-4a7b-8c7c-643797b02a7c roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
16342024-10-24T19:01:43.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 067dc25e-1d77-4a7b-8c7c-643797b02a7c resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
16352024-10-24T19:01:43.812ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2162 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 067dc25e-1d77-4a7b-8c7c-643797b02a7c response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
16362024-10-24T19:01:44.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 8d78ff2b-221f-4376-9c32-0503e8f3d428 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
16372024-10-24T19:01:44.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 8d78ff2b-221f-4376-9c32-0503e8f3d428 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
16382024-10-24T19:01:44.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2481 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 8d78ff2b-221f-4376-9c32-0503e8f3d428 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
16392024-10-24T19:01:45.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = c1f00d64-0f73-48d4-887d-ef47214b0d3b roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
16402024-10-24T19:01:45.857ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = c1f00d64-0f73-48d4-887d-ef47214b0d3b resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
16412024-10-24T19:01:45.859ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2157 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = c1f00d64-0f73-48d4-887d-ef47214b0d3b response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
16422024-10-24T19:01:46.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 788914be-0617-4e3f-9a02-e71dc418eaf8 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
16432024-10-24T19:01:46.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 788914be-0617-4e3f-9a02-e71dc418eaf8 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
16442024-10-24T19:01:46.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2560 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 788914be-0617-4e3f-9a02-e71dc418eaf8 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
16452024-10-24T19:01:47.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 6ca44a74-2c11-4716-b9e5-6889591ea2f7 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
16462024-10-24T19:01:47.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 6ca44a74-2c11-4716-b9e5-6889591ea2f7 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
16472024-10-24T19:01:47.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2139 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 6ca44a74-2c11-4716-b9e5-6889591ea2f7 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
16482024-10-24T19:01:48.533ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
16492024-10-24T19:01:48.534ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
16502024-10-24T19:01:48.534ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16512024-10-24T19:01:48.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16522024-10-24T19:01:48.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16532024-10-24T19:01:48.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16542024-10-24T19:01:48.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16552024-10-24T19:01:48.539ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
16562024-10-24T19:01:48.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16572024-10-24T19:01:48.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16582024-10-24T19:01:48.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16592024-10-24T19:01:48.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16602024-10-24T19:01:48.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16612024-10-24T19:01:48.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: fbb59198-7d6e-40d8-9b05-3fd3707f9c53, lookup_type: ById(fbb59198-7d6e-40d8-9b05-3fd3707f9c53) } result = Ok(())
16622024-10-24T19:01:48.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16632024-10-24T19:01:48.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16642024-10-24T19:01:48.555ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = fbb59198-7d6e-40d8-9b05-3fd3707f9c53 original_time_created = 2024-10-24 18:54:46.689131 UTC target_id = fbb59198-7d6e-40d8-9b05-3fd3707f9c53 time_created = 2024-10-24 18:54:46.689131 UTC
16652024-10-24T19:01:48.555ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.532452ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"fbb59198-7d6e-40d8-9b05-3fd3707f9c53","time_created":"2024-10-24T18:54:46.689131Z"}
16662024-10-24T19:01:48.562ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16672024-10-24T19:01:48.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16682024-10-24T19:01:48.563ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.981402ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
16692024-10-24T19:01:48.922ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 88f832d0-4670-474a-8175-50d4c320a576 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
16702024-10-24T19:01:48.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 88f832d0-4670-474a-8175-50d4c320a576 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
16712024-10-24T19:01:48.924ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1775 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 88f832d0-4670-474a-8175-50d4c320a576 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
16722024-10-24T19:01:49.479ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 471 local_addr = [fd00:1122:3344:101::b]:60338 method = GET remote_addr = [fd00:1122:3344:101::d]:39079 req_id = ba5b5602-1077-428a-af65-44bf0620097c response_code = 200 uri = /51c1446e-49e7-4598-8832-f33ccdf3c076
16732024-10-24T19:01:49.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 5bd7995e-277e-495d-9bc7-ab1d2827bdc9 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
16742024-10-24T19:01:49.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 5bd7995e-277e-495d-9bc7-ab1d2827bdc9 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
16752024-10-24T19:01:49.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2333 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 5bd7995e-277e-495d-9bc7-ab1d2827bdc9 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
16762024-10-24T19:01:50.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 89f8164e-25cb-4772-9017-ccc069cb8048 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
16772024-10-24T19:01:50.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 89f8164e-25cb-4772-9017-ccc069cb8048 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
16782024-10-24T19:01:50.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2354 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 89f8164e-25cb-4772-9017-ccc069cb8048 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
16792024-10-24T19:01:51.988ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 31e1746c-4f2e-4d34-877a-08b667b25158 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
16802024-10-24T19:01:51.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 31e1746c-4f2e-4d34-877a-08b667b25158 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
16812024-10-24T19:01:51.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2335 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 31e1746c-4f2e-4d34-877a-08b667b25158 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
16822024-10-24T19:01:53.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 61cf6dc3-ff66-4917-9427-d3b74b291e00 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
16832024-10-24T19:01:53.013ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 61cf6dc3-ff66-4917-9427-d3b74b291e00 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
16842024-10-24T19:01:53.014ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2474 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 61cf6dc3-ff66-4917-9427-d3b74b291e00 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
16852024-10-24T19:01:54.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 44c10d3d-bbc4-407f-bda3-9c55727850fa roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
16862024-10-24T19:01:54.035ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 44c10d3d-bbc4-407f-bda3-9c55727850fa resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
16872024-10-24T19:01:54.038ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2633 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 44c10d3d-bbc4-407f-bda3-9c55727850fa response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
16882024-10-24T19:01:55.058ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = f1802424-fda9-48f7-abc3-ef46943ee9b0 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
16892024-10-24T19:01:55.058ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = f1802424-fda9-48f7-abc3-ef46943ee9b0 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
16902024-10-24T19:01:55.060ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2501 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = f1802424-fda9-48f7-abc3-ef46943ee9b0 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
16912024-10-24T19:01:56.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 09e4083f-faf5-403d-a138-4365f2e3cdb8 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
16922024-10-24T19:01:56.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 09e4083f-faf5-403d-a138-4365f2e3cdb8 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
16932024-10-24T19:01:56.084ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2425 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 09e4083f-faf5-403d-a138-4365f2e3cdb8 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
16942024-10-24T19:01:57.104ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = ad94f9d5-ee09-4fb9-8e99-b9cd4fe5310e roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
16952024-10-24T19:01:57.105ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = ad94f9d5-ee09-4fb9-8e99-b9cd4fe5310e resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
16962024-10-24T19:01:57.106ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2101 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = ad94f9d5-ee09-4fb9-8e99-b9cd4fe5310e response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
16972024-10-24T19:01:57.524ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59130 req_id = 16d6984a-82f3-4ec2-af8f-fb0cee23119e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
16982024-10-24T19:01:57.524ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59130 req_id = 16d6984a-82f3-4ec2-af8f-fb0cee23119e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
16992024-10-24T19:01:57.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3641 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59130 req_id = 16d6984a-82f3-4ec2-af8f-fb0cee23119e response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
17002024-10-24T19:01:58.126ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 469c09e6-0543-410b-8b6e-67fc506200fb roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
17012024-10-24T19:01:58.127ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 469c09e6-0543-410b-8b6e-67fc506200fb resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
17022024-10-24T19:01:58.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2391 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 469c09e6-0543-410b-8b6e-67fc506200fb response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
17032024-10-24T19:01:58.533ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
17042024-10-24T19:01:58.533ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
17052024-10-24T19:01:58.533ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
17062024-10-24T19:01:58.533ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
17072024-10-24T19:01:58.533ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
17082024-10-24T19:01:58.533ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
17092024-10-24T19:01:58.533ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
17102024-10-24T19:01:58.533ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
17112024-10-24T19:01:58.533ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17122024-10-24T19:01:58.533ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
17132024-10-24T19:01:58.533ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
17142024-10-24T19:01:58.533ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
17152024-10-24T19:01:58.533ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
17162024-10-24T19:01:58.533ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
17172024-10-24T19:01:58.533ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
17182024-10-24T19:01:58.533ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
17192024-10-24T19:01:58.533ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
17202024-10-24T19:01:58.533ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-10-24 18:51:58.533529187 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
17212024-10-24T19:01:58.533ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
17222024-10-24T19:01:58.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
17232024-10-24T19:01:58.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
17242024-10-24T19:01:58.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17252024-10-24T19:01:58.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
17262024-10-24T19:01:58.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
17272024-10-24T19:01:58.534ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
17282024-10-24T19:01:58.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
17292024-10-24T19:01:58.534ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17302024-10-24T19:01:58.534ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
17312024-10-24T19:01:58.534ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
17322024-10-24T19:01:58.534ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
17332024-10-24T19:01:58.534ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17342024-10-24T19:01:58.534ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
17352024-10-24T19:01:58.534ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
17362024-10-24T19:01:58.534ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17372024-10-24T19:01:58.534ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
17382024-10-24T19:01:58.534ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 11.43\u{b5}s iteration = 15 status = {"errors":[],"records_set_to_done":[]}
17392024-10-24T19:01:58.534ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
17402024-10-24T19:01:58.534ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
17412024-10-24T19:01:58.534ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
17422024-10-24T19:01:58.534ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = fbb59198-7d6e-40d8-9b05-3fd3707f9c53
17432024-10-24T19:01:58.534ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
17442024-10-24T19:01:58.534ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
17452024-10-24T19:01:58.534ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 18.5\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"fbb59198-7d6e-40d8-9b05-3fd3707f9c53"}
17462024-10-24T19:01:58.534ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
17472024-10-24T19:01:58.534ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
17482024-10-24T19:01:58.534ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17492024-10-24T19:01:58.534ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
17502024-10-24T19:01:58.534ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17512024-10-24T19:01:58.534ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
17522024-10-24T19:01:58.534ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
17532024-10-24T19:01:58.534ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
17542024-10-24T19:01:58.534ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
17552024-10-24T19:01:58.534ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("06542437-1810-4294-a723-9ed308666b19.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("26818eb7-96aa-486e-ac98-9a5f4e70076d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d4b09213-5961-4095-a130-f1ddc420cb29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d4b09213-5961-4095-a130-f1ddc420cb29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 3361, tv_nsec: 898251894 } })
17562024-10-24T19:01:58.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17572024-10-24T19:01:58.534ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
17582024-10-24T19:01:58.534ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 18.08\u{b5}s iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
17592024-10-24T19:01:58.534ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
17602024-10-24T19:01:58.534ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
17612024-10-24T19:01:58.534ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 6.871\u{b5}s iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
17622024-10-24T19:01:58.534ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
17632024-10-24T19:01:58.534ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17642024-10-24T19:01:58.534ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17652024-10-24T19:01:58.534ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
17662024-10-24T19:01:58.534ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
17672024-10-24T19:01:58.534ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
17682024-10-24T19:01:58.534ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 11.84\u{b5}s iteration = 15 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
17692024-10-24T19:01:58.534ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
17702024-10-24T19:01:58.534ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
17712024-10-24T19:01:58.534ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
17722024-10-24T19:01:58.534ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b130f689-a354-4ce5-be2b-20413d917375.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e40b6155-d379-4874-9119-51a498c972c1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e40b6155-d379-4874-9119-51a498c972c1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 3361, tv_nsec: 898575149 } })
17732024-10-24T19:01:58.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
17742024-10-24T19:01:58.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17752024-10-24T19:01:58.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
17762024-10-24T19:01:58.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17772024-10-24T19:01:58.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17782024-10-24T19:01:58.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17792024-10-24T19:01:58.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17802024-10-24T19:01:58.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
17812024-10-24T19:01:58.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
17822024-10-24T19:01:58.534ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
17832024-10-24T19:01:58.534ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.569064ms iteration = 8 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
17842024-10-24T19:01:58.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
17852024-10-24T19:01:58.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17862024-10-24T19:01:58.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
17872024-10-24T19:01:58.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17882024-10-24T19:01:58.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
17892024-10-24T19:01:58.535ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
17902024-10-24T19:01:58.535ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.593845ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
17912024-10-24T19:01:58.535ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17922024-10-24T19:01:58.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17932024-10-24T19:01:58.536ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8ed5384f-0099-459e-a18a-fdd93abd3452.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8ed5384f-0099-459e-a18a-fdd93abd3452.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3361, tv_nsec: 900465348 } })
17942024-10-24T19:01:58.536ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1105
17952024-10-24T19:01:58.536ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
17962024-10-24T19:01:58.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
17972024-10-24T19:01:58.537ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8ed5384f-0099-459e-a18a-fdd93abd3452.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8ed5384f-0099-459e-a18a-fdd93abd3452.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3361, tv_nsec: 901131958 } })
17982024-10-24T19:01:58.537ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1105
17992024-10-24T19:01:58.537ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18002024-10-24T19:01:58.538ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-10-24 18:51:58.533529187 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
18012024-10-24T19:01:58.538ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.001468ms iteration = 8 status = {"expiration":"2024-10-24T18:51:58.533529187Z","pruned":[]}
18022024-10-24T19:01:58.539ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
18032024-10-24T19:01:58.539ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18042024-10-24T19:01:58.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18052024-10-24T19:01:58.539ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18062024-10-24T19:01:58.541ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.678143ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
18072024-10-24T19:01:58.542ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
18082024-10-24T19:01:58.542ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18092024-10-24T19:01:58.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18102024-10-24T19:01:58.545ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
18112024-10-24T19:01:58.546ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
18122024-10-24T19:01:58.546ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18132024-10-24T19:01:58.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18142024-10-24T19:01:58.547ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 13.148842ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
18152024-10-24T19:01:58.548ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18162024-10-24T19:01:58.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18172024-10-24T19:01:58.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18182024-10-24T19:01:58.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18192024-10-24T19:01:58.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18202024-10-24T19:01:58.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18212024-10-24T19:01:58.585ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18222024-10-24T19:01:58.585ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
18232024-10-24T19:01:58.585ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18242024-10-24T19:01:58.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
18252024-10-24T19:01:58.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18262024-10-24T19:01:58.586ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18272024-10-24T19:01:58.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18282024-10-24T19:01:58.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
18292024-10-24T19:01:58.588ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
18302024-10-24T19:01:58.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
18312024-10-24T19:01:58.588ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18322024-10-24T19:01:58.588ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18332024-10-24T19:01:58.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
18342024-10-24T19:01:58.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18352024-10-24T19:01:58.589ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
18362024-10-24T19:01:58.589ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
18372024-10-24T19:01:58.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
18382024-10-24T19:01:58.589ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18392024-10-24T19:01:58.589ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18402024-10-24T19:01:58.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18412024-10-24T19:01:58.591ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18422024-10-24T19:01:58.591ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
18432024-10-24T19:01:58.591ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18442024-10-24T19:01:58.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18452024-10-24T19:01:58.592ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
18462024-10-24T19:01:58.592ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18472024-10-24T19:01:58.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18482024-10-24T19:01:58.592ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18492024-10-24T19:01:58.595ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
18502024-10-24T19:01:58.595ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
18512024-10-24T19:01:58.595ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 60.727166ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
18522024-10-24T19:01:58.595ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
18532024-10-24T19:01:58.596ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
18542024-10-24T19:01:58.597ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18552024-10-24T19:01:58.597ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18562024-10-24T19:01:58.598ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18572024-10-24T19:01:58.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18582024-10-24T19:01:58.599ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
18592024-10-24T19:01:58.599ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
18602024-10-24T19:01:58.599ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18612024-10-24T19:01:58.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18622024-10-24T19:01:58.601ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
18632024-10-24T19:01:58.601ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18642024-10-24T19:01:58.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18652024-10-24T19:01:58.601ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
18662024-10-24T19:01:58.601ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18672024-10-24T19:01:58.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18682024-10-24T19:01:58.603ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18692024-10-24T19:01:58.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18702024-10-24T19:01:58.604ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18712024-10-24T19:01:58.604ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8ed5384f-0099-459e-a18a-fdd93abd3452.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8ed5384f-0099-459e-a18a-fdd93abd3452.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3361, tv_nsec: 968862902 } })
18722024-10-24T19:01:58.605ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1105 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674
18732024-10-24T19:01:58.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
18742024-10-24T19:01:58.606ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18752024-10-24T19:01:58.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18762024-10-24T19:01:58.623ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
18772024-10-24T19:01:58.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
18782024-10-24T19:01:58.626ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 91.731924ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
18792024-10-24T19:01:58.627ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
18802024-10-24T19:01:58.627ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
18812024-10-24T19:01:58.627ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
18822024-10-24T19:01:58.627ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18832024-10-24T19:01:58.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18842024-10-24T19:01:58.627ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 92.879461ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18852024-10-24T19:01:58.627ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18862024-10-24T19:01:58.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18872024-10-24T19:01:58.631ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18882024-10-24T19:01:58.632ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18892024-10-24T19:01:58.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18902024-10-24T19:01:58.635ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
18912024-10-24T19:01:58.635ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
18922024-10-24T19:01:58.635ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
18932024-10-24T19:01:58.635ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18942024-10-24T19:01:58.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18952024-10-24T19:01:58.635ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18962024-10-24T19:01:58.635ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
18972024-10-24T19:01:58.635ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18982024-10-24T19:01:58.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18992024-10-24T19:01:58.637ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19002024-10-24T19:01:58.639ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: fbb59198-7d6e-40d8-9b05-3fd3707f9c53, lookup_type: ById(fbb59198-7d6e-40d8-9b05-3fd3707f9c53) } result = Ok(())
19012024-10-24T19:01:58.639ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19022024-10-24T19:01:58.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19032024-10-24T19:01:58.642ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
19042024-10-24T19:01:58.642ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19052024-10-24T19:01:58.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19062024-10-24T19:01:58.642ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19072024-10-24T19:01:58.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19082024-10-24T19:01:58.645ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
19092024-10-24T19:01:58.645ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
19102024-10-24T19:01:58.645ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 110.832939ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
19112024-10-24T19:01:58.649ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
19122024-10-24T19:01:58.649ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 115.137835ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
19132024-10-24T19:01:58.652ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19142024-10-24T19:01:58.652ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
19152024-10-24T19:01:58.652ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 117.886107ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
19162024-10-24T19:01:58.652ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = fbb59198-7d6e-40d8-9b05-3fd3707f9c53 original_time_created = 2024-10-24 18:54:46.689131 UTC target_id = fbb59198-7d6e-40d8-9b05-3fd3707f9c53 time_created = 2024-10-24 18:54:46.689131 UTC
19172024-10-24T19:01:58.652ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 118.07797ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"fbb59198-7d6e-40d8-9b05-3fd3707f9c53","time_created":"2024-10-24T18:54:46.689131Z"}
19182024-10-24T19:01:58.661ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1113 zone_address = fd00:1122:3344:101::2
19192024-10-24T19:01:58.661ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19202024-10-24T19:01:58.664ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b54062bd-b15a-4cdb-8b66-5b664a6b06ad", "content-length": "26", "date": "Thu, 24 Oct 2024 19:01:58 GMT"} })
19212024-10-24T19:01:58.664ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1118 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19222024-10-24T19:01:58.664ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1150 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19232024-10-24T19:01:58.674ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19242024-10-24T19:01:58.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19252024-10-24T19:01:58.683ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1113 zone_address = fd00:1122:3344:101::2
19262024-10-24T19:01:58.683ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19272024-10-24T19:01:58.683ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "84cd0bd3-1a17-4ef3-951e-c8048855bc2d", "content-length": "26", "date": "Thu, 24 Oct 2024 19:01:58 GMT"} })
19282024-10-24T19:01:58.683ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1118 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19292024-10-24T19:01:58.685ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19302024-10-24T19:01:58.686ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1150 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19312024-10-24T19:01:58.688ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8ed5384f-0099-459e-a18a-fdd93abd3452, lookup_type: ById(8ed5384f-0099-459e-a18a-fdd93abd3452) } result = Ok(())
19322024-10-24T19:01:58.689ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19332024-10-24T19:01:58.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19342024-10-24T19:01:58.691ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19352024-10-24T19:01:58.691ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 157.525657ms iteration = 15 status = 0
19362024-10-24T19:01:58.692ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
19372024-10-24T19:01:58.692ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 40d8768c-5b67-41c8-8a5f-c7782dbfc898 dns_zone_name = oxide.test found_so_far = 0 version = 2
19382024-10-24T19:01:58.692ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19392024-10-24T19:01:58.692ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
19402024-10-24T19:01:58.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19412024-10-24T19:01:58.693ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
19422024-10-24T19:01:58.693ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19432024-10-24T19:01:58.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19442024-10-24T19:01:58.694ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19452024-10-24T19:01:58.699ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
19462024-10-24T19:01:58.699ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19472024-10-24T19:01:58.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19482024-10-24T19:01:58.700ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
19492024-10-24T19:01:58.700ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 6ae7917d-db6c-4390-ad36-16f7cdab058b dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
19502024-10-24T19:01:58.700ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19512024-10-24T19:01:58.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19522024-10-24T19:01:58.701ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 40d8768c-5b67-41c8-8a5f-c7782dbfc898 dns_zone_name = oxide.test found_so_far = 1 version = 2
19532024-10-24T19:01:58.701ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
19542024-10-24T19:01:58.701ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-10-24 18:55:01.522538 UTC dns_group = external generation = 2
19552024-10-24T19:01:58.701ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 167.694804ms iteration = 8 status = {"generation":2}
19562024-10-24T19:01:58.702ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19572024-10-24T19:01:58.704ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
19582024-10-24T19:01:58.706ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
19592024-10-24T19:01:58.706ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19602024-10-24T19:01:58.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19612024-10-24T19:01:58.709ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 6ae7917d-db6c-4390-ad36-16f7cdab058b dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
19622024-10-24T19:01:58.709ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
19632024-10-24T19:01:58.709ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-10-24 18:55:00.465937 UTC dns_group = internal generation = 1
19642024-10-24T19:01:58.709ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 175.90608ms iteration = 8 status = {"generation":1}
19652024-10-24T19:01:58.755ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-10-24T18:54:56.514007Z, time_modified: 2024-10-24T18:54:56.514007Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 68627db6-53a8-4390-a3e6-e94f65d72ce7, db_silo: Silo { identity: SiloIdentity { id: 68627db6-53a8-4390-a3e6-e94f65d72ce7, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-24T18:55:01.468978Z, time_modified: 2024-10-24T18:55:01.468978Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "1c746763ac1d0b5e2ef2147ce9044dbc34dc4c4b966a58bca0aa0568eb6d1351" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 68627db6-53a8-4390-a3e6-e94f65d72ce7, db_silo: Silo { identity: SiloIdentity { id: 68627db6-53a8-4390-a3e6-e94f65d72ce7, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-24T18:55:01.468978Z, time_modified: 2024-10-24T18:55:01.468978Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "1c746763ac1d0b5e2ef2147ce9044dbc34dc4c4b966a58bca0aa0568eb6d1351" }] }) }
19662024-10-24T19:01:58.755ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 222.058592ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"68627db6-53a8-4390-a3e6-e94f65d72ce7","tls_certs":["1c746763ac1d0b5e2ef2147ce9044dbc34dc4c4b966a58bca0aa0568eb6d1351"]}},"default_endpoint":{"silo_id":"68627db6-53a8-4390-a3e6-e94f65d72ce7","tls_certs":["1c746763ac1d0b5e2ef2147ce9044dbc34dc4c4b966a58bca0aa0568eb6d1351"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
19672024-10-24T19:01:58.757ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 223.447004ms iteration = 17 status = {"physical_disks_added":0}
19682024-10-24T19:01:58.764ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
19692024-10-24T19:01:58.764ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 230.073626ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
19702024-10-24T19:01:58.807ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19712024-10-24T19:01:58.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19722024-10-24T19:01:58.808ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 274.646123ms iteration = 15 status = {}
19732024-10-24T19:01:58.863ZINFOnexus (BackgroundTasks): VPC route manager sled 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
19742024-10-24T19:01:58.863ZDEBGnexus (BackgroundTasks): client request SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
19752024-10-24T19:01:58.864ZDEBGnexus (BackgroundTasks): client response SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "f87ea5b8-ca9b-4807-8793-45ad14f1c036", "content-length": "372", "date": "Thu, 24 Oct 2024 19:01:58 GMT"} })
19762024-10-24T19:01:58.864ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19772024-10-24T19:01:58.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19782024-10-24T19:01:58.902ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19792024-10-24T19:01:58.904ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
19802024-10-24T19:01:58.904ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19812024-10-24T19:01:58.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19822024-10-24T19:01:58.905ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19832024-10-24T19:01:58.908ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
19842024-10-24T19:01:58.908ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19852024-10-24T19:01:58.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19862024-10-24T19:01:58.926ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1113 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 zone_address = fd00:1122:3344:101::2
19872024-10-24T19:01:58.926ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19882024-10-24T19:01:58.926ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ddb2faa0-9c89-45d2-be4e-79d54bffce61", "content-length": "26", "date": "Thu, 24 Oct 2024 19:01:58 GMT"} })
19892024-10-24T19:01:58.926ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1118 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19902024-10-24T19:01:58.927ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
19912024-10-24T19:01:58.927ZDEBGnexus (BackgroundTasks): client request SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
19922024-10-24T19:01:58.927ZDEBGnexus (BackgroundTasks): client response SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3e271bd1-16f4-4761-887f-60b00214f5d0", "date": "Thu, 24 Oct 2024 19:01:58 GMT"} })
19932024-10-24T19:01:58.927ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19942024-10-24T19:01:58.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19952024-10-24T19:01:58.929ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1150 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674
19962024-10-24T19:01:58.935ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19972024-10-24T19:01:58.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19982024-10-24T19:01:58.938ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19992024-10-24T19:01:58.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20002024-10-24T19:01:58.943ZINFOnexus (BackgroundTasks): VPC route manager sled 8ed5384f-0099-459e-a18a-fdd93abd3452 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
20012024-10-24T19:01:58.943ZDEBGnexus (BackgroundTasks): client request SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
20022024-10-24T19:01:58.944ZDEBGnexus (BackgroundTasks): client response SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c2f071a1-53f0-4957-80b4-73f8c112e86d", "date": "Thu, 24 Oct 2024 19:01:58 GMT"} })
20032024-10-24T19:01:58.945ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
20042024-10-24T19:01:58.945ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 411.618615ms iteration = 16 status = {}
20052024-10-24T19:01:58.946ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e0aab61-2a52-424d-a5d0-c9f1e9be9c94", "content-length": "2", "date": "Thu, 24 Oct 2024 19:01:58 GMT"} })
20062024-10-24T19:01:58.948ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
20072024-10-24T19:01:58.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
20082024-10-24T19:01:58.948ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
20092024-10-24T19:01:58.950ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 417.099719ms iteration = 15 status = null
20102024-10-24T19:01:58.968ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
20112024-10-24T19:01:58.968ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "be466716-96e9-4c75-98f0-99d7aa445eab", "date": "Thu, 24 Oct 2024 19:01:58 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
20122024-10-24T19:01:58.968ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
20132024-10-24T19:01:58.974ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "d1b2f064-be3d-45f6-a610-b4e3069ca3aa", "date": "Thu, 24 Oct 2024 19:01:58 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
20142024-10-24T19:01:58.974ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
20152024-10-24T19:01:58.975ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
20162024-10-24T19:01:58.975ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 442.559691ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
20172024-10-24T19:01:59.102ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
20182024-10-24T19:01:59.103ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "faba1ef9-a15e-4372-bbd5-1ae24cd87e8e", "date": "Thu, 24 Oct 2024 19:01:59 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
20192024-10-24T19:01:59.103ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
20202024-10-24T19:01:59.104ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "d2da782c-e42f-4d31-ad04-bdb44e66b947", "date": "Thu, 24 Oct 2024 19:01:59 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
20212024-10-24T19:01:59.104ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
20222024-10-24T19:01:59.106ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "813d8af7-79a5-497b-9039-45d34965752d", "date": "Thu, 24 Oct 2024 19:01:59 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
20232024-10-24T19:01:59.106ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
20242024-10-24T19:01:59.108ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
20252024-10-24T19:01:59.108ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 574.838141ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
20262024-10-24T19:01:59.132ZDEBGnexus (BackgroundTasks): client request SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
20272024-10-24T19:01:59.133ZDEBGnexus (BackgroundTasks): client response SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e00c5bc3-723e-4080-8c5c-6f05fd71e6f3", "content-length": "691", "date": "Thu, 24 Oct 2024 19:01:58 GMT"} })
20282024-10-24T19:01:59.133ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
20292024-10-24T19:01:59.133ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
20302024-10-24T19:01:59.133ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
20312024-10-24T19:01:59.134ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 600.352764ms iteration = 16 status = {}
20322024-10-24T19:01:59.147ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20332024-10-24T19:01:59.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20342024-10-24T19:01:59.148ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = f7c97d72-8e9f-421a-9cb9-0d0f77225d09 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
20352024-10-24T19:01:59.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = f7c97d72-8e9f-421a-9cb9-0d0f77225d09 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
20362024-10-24T19:01:59.150ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 95766534-d8e7-4baf-bb18-72c7cf344605, rack_id: d6d74c37-fa13-4dad-8a2e-066574b53674, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(d796208a-628d-40ec-83c5-b72b8cbc0e00) } rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 switch_location = Switch0
20372024-10-24T19:01:59.150ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20382024-10-24T19:01:59.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20392024-10-24T19:01:59.151ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3093 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = f7c97d72-8e9f-421a-9cb9-0d0f77225d09 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
20402024-10-24T19:01:59.160ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
20412024-10-24T19:01:59.160ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "c41a2c65-3e4d-4e6c-ba01-07823c47b23f", "content-length": "121", "date": "Thu, 24 Oct 2024 19:01:58 GMT"} })
20422024-10-24T19:01:59.160ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
20432024-10-24T19:01:59.160ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = d796208a-628d-40ec-83c5-b72b8cbc0e00
20442024-10-24T19:01:59.160ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
20452024-10-24T19:01:59.160ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
20462024-10-24T19:01:59.160ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20472024-10-24T19:01:59.160ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20482024-10-24T19:01:59.160ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20492024-10-24T19:01:59.160ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
20502024-10-24T19:01:59.161ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20512024-10-24T19:01:59.161ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
20522024-10-24T19:01:59.161ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674
20532024-10-24T19:01:59.161ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20542024-10-24T19:01:59.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20552024-10-24T19:01:59.163ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
20562024-10-24T19:01:59.164ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5894006-723b-4bcb-ba6a-9302a2aacff2", "content-length": "2", "date": "Thu, 24 Oct 2024 19:01:58 GMT"} })
20572024-10-24T19:01:59.164ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
20582024-10-24T19:01:59.164ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "1a0c1e80-cbf0-4462-b244-31f6f22734db", "content-length": "52", "date": "Thu, 24 Oct 2024 19:01:58 GMT"} })
20592024-10-24T19:01:59.164ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 switch_location = Switch0
20602024-10-24T19:01:59.164ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
20612024-10-24T19:01:59.267ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "cdbb5c79-28f9-4623-85d9-2d07ad084c61", "date": "Thu, 24 Oct 2024 19:01:58 GMT"} })
20622024-10-24T19:01:59.267ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 switch = Switch0
20632024-10-24T19:01:59.267ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
20642024-10-24T19:01:59.268ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c8e23ae0-774f-4551-9686-dbf7c772f6fb", "content-length": "669", "date": "Thu, 24 Oct 2024 19:01:59 GMT"} })
20652024-10-24T19:01:59.268ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20662024-10-24T19:01:59.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20672024-10-24T19:01:59.272ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20682024-10-24T19:01:59.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20692024-10-24T19:01:59.276ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20702024-10-24T19:01:59.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20712024-10-24T19:01:59.279ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20722024-10-24T19:01:59.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20732024-10-24T19:01:59.286ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 752.508189ms iteration = 15 status = {}
20742024-10-24T19:01:59.479ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 548 local_addr = [fd00:1122:3344:101::b]:60338 method = GET remote_addr = [fd00:1122:3344:101::d]:39079 req_id = b51803cd-f26b-44a2-9ade-563cb8c9f8e5 response_code = 200 uri = /51c1446e-49e7-4598-8832-f33ccdf3c076
20752024-10-24T19:02:00.269ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = a961d6a4-e503-4aa5-9bcf-8a4357b0ccc0 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
20762024-10-24T19:02:00.270ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = a961d6a4-e503-4aa5-9bcf-8a4357b0ccc0 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
20772024-10-24T19:02:00.272ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2575 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = a961d6a4-e503-4aa5-9bcf-8a4357b0ccc0 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
20782024-10-24T19:02:01.293ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = c79f5be7-0116-42dc-b56e-4cf30f2d5a30 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
20792024-10-24T19:02:01.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = c79f5be7-0116-42dc-b56e-4cf30f2d5a30 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
20802024-10-24T19:02:01.295ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2214 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = c79f5be7-0116-42dc-b56e-4cf30f2d5a30 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
20812024-10-24T19:02:02.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 7555de9f-8589-4ffb-9449-f8b65528cd4c roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
20822024-10-24T19:02:02.316ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 7555de9f-8589-4ffb-9449-f8b65528cd4c resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
20832024-10-24T19:02:02.319ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3188 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 7555de9f-8589-4ffb-9449-f8b65528cd4c response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
20842024-10-24T19:02:03.341ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 06dab5e8-974a-4bac-89d0-bc9afc342b2f roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
20852024-10-24T19:02:03.341ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 06dab5e8-974a-4bac-89d0-bc9afc342b2f resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
20862024-10-24T19:02:03.343ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2639 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 06dab5e8-974a-4bac-89d0-bc9afc342b2f response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
20872024-10-24T19:02:04.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 768afc86-0e06-416a-9492-aba2b799b65b roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
20882024-10-24T19:02:04.365ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 768afc86-0e06-416a-9492-aba2b799b65b resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
20892024-10-24T19:02:04.367ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2818 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 768afc86-0e06-416a-9492-aba2b799b65b response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
20902024-10-24T19:02:05.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = de88f212-f820-4e7f-8c8f-2caa0466166c roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
20912024-10-24T19:02:05.388ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = de88f212-f820-4e7f-8c8f-2caa0466166c resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
20922024-10-24T19:02:05.390ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2326 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = de88f212-f820-4e7f-8c8f-2caa0466166c response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
20932024-10-24T19:02:06.411ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 79dd997a-080f-4d32-b33a-320ece474146 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
20942024-10-24T19:02:06.412ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 79dd997a-080f-4d32-b33a-320ece474146 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
20952024-10-24T19:02:06.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2107 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 79dd997a-080f-4d32-b33a-320ece474146 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
20962024-10-24T19:02:07.434ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 25166b87-7c0c-4d0a-afab-e5a1c674e154 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
20972024-10-24T19:02:07.435ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 25166b87-7c0c-4d0a-afab-e5a1c674e154 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
20982024-10-24T19:02:07.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2282 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 25166b87-7c0c-4d0a-afab-e5a1c674e154 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
20992024-10-24T19:02:08.457ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = b056456e-33b1-4541-b042-8ef78bbc445d roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
21002024-10-24T19:02:08.457ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = b056456e-33b1-4541-b042-8ef78bbc445d resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
21012024-10-24T19:02:08.459ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2457 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = b056456e-33b1-4541-b042-8ef78bbc445d response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
21022024-10-24T19:02:08.534ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
21032024-10-24T19:02:08.534ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
21042024-10-24T19:02:08.534ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21052024-10-24T19:02:08.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21062024-10-24T19:02:08.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21072024-10-24T19:02:08.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21082024-10-24T19:02:08.565ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21092024-10-24T19:02:08.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21102024-10-24T19:02:08.567ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.719715ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21112024-10-24T19:02:08.568ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21122024-10-24T19:02:08.571ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21132024-10-24T19:02:08.571ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21142024-10-24T19:02:08.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21152024-10-24T19:02:08.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21162024-10-24T19:02:08.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21172024-10-24T19:02:08.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21182024-10-24T19:02:08.577ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: fbb59198-7d6e-40d8-9b05-3fd3707f9c53, lookup_type: ById(fbb59198-7d6e-40d8-9b05-3fd3707f9c53) } result = Ok(())
21192024-10-24T19:02:08.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21202024-10-24T19:02:08.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21212024-10-24T19:02:08.586ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = fbb59198-7d6e-40d8-9b05-3fd3707f9c53 original_time_created = 2024-10-24 18:54:46.689131 UTC target_id = fbb59198-7d6e-40d8-9b05-3fd3707f9c53 time_created = 2024-10-24 18:54:46.689131 UTC
21222024-10-24T19:02:08.586ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 51.689567ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"fbb59198-7d6e-40d8-9b05-3fd3707f9c53","time_created":"2024-10-24T18:54:46.689131Z"}
21232024-10-24T19:02:09.480ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 866 local_addr = [fd00:1122:3344:101::b]:60338 method = GET remote_addr = [fd00:1122:3344:101::d]:39079 req_id = 0751d71a-1233-4ac7-9292-f0b6906fcdb7 response_code = 200 uri = /51c1446e-49e7-4598-8832-f33ccdf3c076
21242024-10-24T19:02:09.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 6d741e28-8353-46b8-84e8-2f431574f676 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
21252024-10-24T19:02:09.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 6d741e28-8353-46b8-84e8-2f431574f676 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
21262024-10-24T19:02:09.482ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2008 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 6d741e28-8353-46b8-84e8-2f431574f676 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
21272024-10-24T19:02:10.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 48830eff-e978-47f8-b7e9-57b4f15b956f roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
21282024-10-24T19:02:10.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 48830eff-e978-47f8-b7e9-57b4f15b956f resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
21292024-10-24T19:02:10.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1857 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 48830eff-e978-47f8-b7e9-57b4f15b956f response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
21302024-10-24T19:02:11.524ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = b3645e02-cf94-4352-8f8b-8bd277517adf roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
21312024-10-24T19:02:11.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = b3645e02-cf94-4352-8f8b-8bd277517adf resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
21322024-10-24T19:02:11.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2404 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = b3645e02-cf94-4352-8f8b-8bd277517adf response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
21332024-10-24T19:02:12.548ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = e75393b2-d623-4830-aa91-aa02b59706f8 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
21342024-10-24T19:02:12.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = e75393b2-d623-4830-aa91-aa02b59706f8 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
21352024-10-24T19:02:12.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2401 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = e75393b2-d623-4830-aa91-aa02b59706f8 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
21362024-10-24T19:02:13.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = dd4a353b-9d3c-4a66-a1e0-22d82f3ab3bd roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
21372024-10-24T19:02:13.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = dd4a353b-9d3c-4a66-a1e0-22d82f3ab3bd resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
21382024-10-24T19:02:13.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2268 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = dd4a353b-9d3c-4a66-a1e0-22d82f3ab3bd response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
21392024-10-24T19:02:14.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = b88af99d-72df-4e80-8776-2ae879180f63 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
21402024-10-24T19:02:14.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = b88af99d-72df-4e80-8776-2ae879180f63 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
21412024-10-24T19:02:14.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2567 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = b88af99d-72df-4e80-8776-2ae879180f63 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
21422024-10-24T19:02:15.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 46d649a3-5826-4f6b-91a3-05e9629d081d roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
21432024-10-24T19:02:15.618ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 46d649a3-5826-4f6b-91a3-05e9629d081d resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
21442024-10-24T19:02:15.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1883 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 46d649a3-5826-4f6b-91a3-05e9629d081d response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
21452024-10-24T19:02:16.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 08cbb7c0-e911-4ae6-b809-02c2de2a4e89 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
21462024-10-24T19:02:16.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 08cbb7c0-e911-4ae6-b809-02c2de2a4e89 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
21472024-10-24T19:02:16.642ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2323 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 08cbb7c0-e911-4ae6-b809-02c2de2a4e89 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
21482024-10-24T19:02:17.663ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = f1fc9cab-c41b-405b-b8b0-52fa4b4fef2a roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
21492024-10-24T19:02:17.663ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = f1fc9cab-c41b-405b-b8b0-52fa4b4fef2a resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
21502024-10-24T19:02:17.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2804 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = f1fc9cab-c41b-405b-b8b0-52fa4b4fef2a response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
21512024-10-24T19:02:18.534ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
21522024-10-24T19:02:18.534ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
21532024-10-24T19:02:18.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21542024-10-24T19:02:18.534ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21552024-10-24T19:02:18.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21562024-10-24T19:02:18.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21572024-10-24T19:02:18.537ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21582024-10-24T19:02:18.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21592024-10-24T19:02:18.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21602024-10-24T19:02:18.539ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.396568ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21612024-10-24T19:02:18.540ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21622024-10-24T19:02:18.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21632024-10-24T19:02:18.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21642024-10-24T19:02:18.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21652024-10-24T19:02:18.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21662024-10-24T19:02:18.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21672024-10-24T19:02:18.546ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: fbb59198-7d6e-40d8-9b05-3fd3707f9c53, lookup_type: ById(fbb59198-7d6e-40d8-9b05-3fd3707f9c53) } result = Ok(())
21682024-10-24T19:02:18.546ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21692024-10-24T19:02:18.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21702024-10-24T19:02:18.553ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = fbb59198-7d6e-40d8-9b05-3fd3707f9c53 original_time_created = 2024-10-24 18:54:46.689131 UTC target_id = fbb59198-7d6e-40d8-9b05-3fd3707f9c53 time_created = 2024-10-24 18:54:46.689131 UTC
21712024-10-24T19:02:18.553ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.104625ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"fbb59198-7d6e-40d8-9b05-3fd3707f9c53","time_created":"2024-10-24T18:54:46.689131Z"}
21722024-10-24T19:02:18.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = d8986fa9-15a0-4fa0-bd33-d6a9ea00792a roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
21732024-10-24T19:02:18.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = d8986fa9-15a0-4fa0-bd33-d6a9ea00792a resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
21742024-10-24T19:02:18.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1747 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = d8986fa9-15a0-4fa0-bd33-d6a9ea00792a response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
21752024-10-24T19:02:19.480ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 801 local_addr = [fd00:1122:3344:101::b]:60338 method = GET remote_addr = [fd00:1122:3344:101::d]:39079 req_id = 64cf3dfb-f868-4adc-9338-a1054ef64e54 response_code = 200 uri = /51c1446e-49e7-4598-8832-f33ccdf3c076
21762024-10-24T19:02:19.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 8338c315-d55a-47b3-8781-8b9a58d0ac6b roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
21772024-10-24T19:02:19.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 8338c315-d55a-47b3-8781-8b9a58d0ac6b resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
21782024-10-24T19:02:19.710ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1988 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 8338c315-d55a-47b3-8781-8b9a58d0ac6b response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
21792024-10-24T19:02:20.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 3dbab418-8224-4e23-9bb4-609e9e400e9e roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
21802024-10-24T19:02:20.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 3dbab418-8224-4e23-9bb4-609e9e400e9e resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
21812024-10-24T19:02:20.734ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3047 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 3dbab418-8224-4e23-9bb4-609e9e400e9e response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
21822024-10-24T19:02:21.755ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 6b719684-c0f1-4d04-982a-9d980fa9d7d0 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
21832024-10-24T19:02:21.755ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 6b719684-c0f1-4d04-982a-9d980fa9d7d0 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
21842024-10-24T19:02:21.757ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2683 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 6b719684-c0f1-4d04-982a-9d980fa9d7d0 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
21852024-10-24T19:02:22.778ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 003beb5b-c94f-48f9-ab5d-775a790a7147 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
21862024-10-24T19:02:22.778ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 003beb5b-c94f-48f9-ab5d-775a790a7147 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
21872024-10-24T19:02:22.780ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2141 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 003beb5b-c94f-48f9-ab5d-775a790a7147 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
21882024-10-24T19:02:23.800ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 74f3707b-2600-4a03-b8c9-5384fdbb3d89 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
21892024-10-24T19:02:23.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 74f3707b-2600-4a03-b8c9-5384fdbb3d89 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
21902024-10-24T19:02:23.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2291 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 74f3707b-2600-4a03-b8c9-5384fdbb3d89 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
21912024-10-24T19:02:24.822ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = b2839a54-00ca-4a68-9307-e60bb69b5566 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
21922024-10-24T19:02:24.822ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = b2839a54-00ca-4a68-9307-e60bb69b5566 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
21932024-10-24T19:02:24.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1883 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = b2839a54-00ca-4a68-9307-e60bb69b5566 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
21942024-10-24T19:02:25.845ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 6b32b72f-4dc2-4c2d-bd6a-ca4abc16954f roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
21952024-10-24T19:02:25.845ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 6b32b72f-4dc2-4c2d-bd6a-ca4abc16954f resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
21962024-10-24T19:02:25.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2342 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 6b32b72f-4dc2-4c2d-bd6a-ca4abc16954f response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
21972024-10-24T19:02:26.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 07a4d361-0f31-4e70-908d-882958b94212 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
21982024-10-24T19:02:26.869ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 07a4d361-0f31-4e70-908d-882958b94212 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
21992024-10-24T19:02:26.871ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2754 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 07a4d361-0f31-4e70-908d-882958b94212 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
22002024-10-24T19:02:27.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59130 req_id = 1d47302b-081f-4f01-87af-f00ad60ddae4 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
22012024-10-24T19:02:27.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59130 req_id = 1d47302b-081f-4f01-87af-f00ad60ddae4 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
22022024-10-24T19:02:27.562ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3634 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59130 req_id = 1d47302b-081f-4f01-87af-f00ad60ddae4 response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
22032024-10-24T19:02:27.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 6acc20c2-cedd-4dfb-a694-e23f08ec3cc5 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
22042024-10-24T19:02:27.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 6acc20c2-cedd-4dfb-a694-e23f08ec3cc5 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
22052024-10-24T19:02:27.893ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2615 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 6acc20c2-cedd-4dfb-a694-e23f08ec3cc5 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
22062024-10-24T19:02:28.534ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
22072024-10-24T19:02:28.534ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
22082024-10-24T19:02:28.534ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
22092024-10-24T19:02:28.534ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
22102024-10-24T19:02:28.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
22112024-10-24T19:02:28.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
22122024-10-24T19:02:28.535ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
22132024-10-24T19:02:28.535ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
22142024-10-24T19:02:28.535ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 13.12\u{b5}s iteration = 16 status = {"errors":[],"records_set_to_done":[]}
22152024-10-24T19:02:28.535ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
22162024-10-24T19:02:28.535ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
22172024-10-24T19:02:28.535ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
22182024-10-24T19:02:28.535ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
22192024-10-24T19:02:28.535ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22202024-10-24T19:02:28.535ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
22212024-10-24T19:02:28.535ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22222024-10-24T19:02:28.535ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22232024-10-24T19:02:28.535ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
22242024-10-24T19:02:28.535ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
22252024-10-24T19:02:28.535ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22262024-10-24T19:02:28.535ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
22272024-10-24T19:02:28.535ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
22282024-10-24T19:02:28.535ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
22292024-10-24T19:02:28.535ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 16.841\u{b5}s iteration = 16 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
22302024-10-24T19:02:28.535ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
22312024-10-24T19:02:28.535ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
22322024-10-24T19:02:28.535ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22332024-10-24T19:02:28.535ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
22342024-10-24T19:02:28.535ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
22352024-10-24T19:02:28.535ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.31\u{b5}s iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
22362024-10-24T19:02:28.535ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
22372024-10-24T19:02:28.535ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 5.289\u{b5}s iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
22382024-10-24T19:02:28.535ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
22392024-10-24T19:02:28.535ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
22402024-10-24T19:02:28.535ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22412024-10-24T19:02:28.535ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
22422024-10-24T19:02:28.535ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22432024-10-24T19:02:28.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22442024-10-24T19:02:28.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
22452024-10-24T19:02:28.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
22462024-10-24T19:02:28.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22472024-10-24T19:02:28.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
22482024-10-24T19:02:28.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22492024-10-24T19:02:28.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
22502024-10-24T19:02:28.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22512024-10-24T19:02:28.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22522024-10-24T19:02:28.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22532024-10-24T19:02:28.537ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8ed5384f-0099-459e-a18a-fdd93abd3452.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8ed5384f-0099-459e-a18a-fdd93abd3452.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3391, tv_nsec: 900715333 } })
22542024-10-24T19:02:28.537ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1105
22552024-10-24T19:02:28.537ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8ed5384f-0099-459e-a18a-fdd93abd3452.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8ed5384f-0099-459e-a18a-fdd93abd3452.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3391, tv_nsec: 901168320 } })
22562024-10-24T19:02:28.537ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22572024-10-24T19:02:28.537ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1105
22582024-10-24T19:02:28.538ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22592024-10-24T19:02:28.539ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.044032ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
22602024-10-24T19:02:28.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22612024-10-24T19:02:28.539ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22622024-10-24T19:02:28.541ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
22632024-10-24T19:02:28.541ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22642024-10-24T19:02:28.541ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
22652024-10-24T19:02:28.541ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22662024-10-24T19:02:28.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22672024-10-24T19:02:28.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
22682024-10-24T19:02:28.542ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
22692024-10-24T19:02:28.542ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
22702024-10-24T19:02:28.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
22712024-10-24T19:02:28.542ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
22722024-10-24T19:02:28.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22732024-10-24T19:02:28.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22742024-10-24T19:02:28.543ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22752024-10-24T19:02:28.543ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22762024-10-24T19:02:28.545ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
22772024-10-24T19:02:28.545ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22782024-10-24T19:02:28.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22792024-10-24T19:02:28.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
22802024-10-24T19:02:28.545ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22812024-10-24T19:02:28.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22822024-10-24T19:02:28.546ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22832024-10-24T19:02:28.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22842024-10-24T19:02:28.548ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22852024-10-24T19:02:28.548ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22862024-10-24T19:02:28.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22872024-10-24T19:02:28.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
22882024-10-24T19:02:28.548ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22892024-10-24T19:02:28.549ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22902024-10-24T19:02:28.550ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8ed5384f-0099-459e-a18a-fdd93abd3452.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8ed5384f-0099-459e-a18a-fdd93abd3452.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3391, tv_nsec: 913733943 } })
22912024-10-24T19:02:28.550ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1105 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674
22922024-10-24T19:02:28.551ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
22932024-10-24T19:02:28.551ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22942024-10-24T19:02:28.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22952024-10-24T19:02:28.553ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: fbb59198-7d6e-40d8-9b05-3fd3707f9c53, lookup_type: ById(fbb59198-7d6e-40d8-9b05-3fd3707f9c53) } result = Ok(())
22962024-10-24T19:02:28.553ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22972024-10-24T19:02:28.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22982024-10-24T19:02:28.555ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22992024-10-24T19:02:28.557ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
23002024-10-24T19:02:28.557ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23012024-10-24T19:02:28.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23022024-10-24T19:02:28.559ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23032024-10-24T19:02:28.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23042024-10-24T19:02:28.570ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = fbb59198-7d6e-40d8-9b05-3fd3707f9c53 original_time_created = 2024-10-24 18:54:46.689131 UTC target_id = fbb59198-7d6e-40d8-9b05-3fd3707f9c53 time_created = 2024-10-24 18:54:46.689131 UTC
23052024-10-24T19:02:28.570ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 35.447646ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"fbb59198-7d6e-40d8-9b05-3fd3707f9c53","time_created":"2024-10-24T18:54:46.689131Z"}
23062024-10-24T19:02:28.580ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
23072024-10-24T19:02:28.580ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
23082024-10-24T19:02:28.580ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
23092024-10-24T19:02:28.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
23102024-10-24T19:02:28.585ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23112024-10-24T19:02:28.585ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23122024-10-24T19:02:28.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23132024-10-24T19:02:28.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23142024-10-24T19:02:28.586ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 51.419892ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
23152024-10-24T19:02:28.588ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23162024-10-24T19:02:28.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23172024-10-24T19:02:28.589ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
23182024-10-24T19:02:28.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
23192024-10-24T19:02:28.589ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23202024-10-24T19:02:28.592ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8ed5384f-0099-459e-a18a-fdd93abd3452, lookup_type: ById(8ed5384f-0099-459e-a18a-fdd93abd3452) } result = Ok(())
23212024-10-24T19:02:28.592ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23222024-10-24T19:02:28.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23232024-10-24T19:02:28.595ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 59.895134ms iteration = 16 status = 0
23242024-10-24T19:02:28.595ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
23252024-10-24T19:02:28.595ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 60.461622ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
23262024-10-24T19:02:28.609ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
23272024-10-24T19:02:28.609ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
23282024-10-24T19:02:28.609ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
23292024-10-24T19:02:28.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
23302024-10-24T19:02:28.615ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 80.013714ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
23312024-10-24T19:02:28.618ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1113 zone_address = fd00:1122:3344:101::2
23322024-10-24T19:02:28.618ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
23332024-10-24T19:02:28.619ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b8d069f1-69f7-4531-baef-704d702b26da", "content-length": "26", "date": "Thu, 24 Oct 2024 19:02:28 GMT"} })
23342024-10-24T19:02:28.619ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1118 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
23352024-10-24T19:02:28.620ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1150 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
23362024-10-24T19:02:28.627ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1113 zone_address = fd00:1122:3344:101::2
23372024-10-24T19:02:28.627ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
23382024-10-24T19:02:28.627ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "18a8030d-6bac-4243-8e2c-e4b261b46df2", "content-length": "26", "date": "Thu, 24 Oct 2024 19:02:28 GMT"} })
23392024-10-24T19:02:28.627ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1118 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
23402024-10-24T19:02:28.628ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1113 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 zone_address = fd00:1122:3344:101::2
23412024-10-24T19:02:28.628ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
23422024-10-24T19:02:28.628ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "523d3bd2-2c01-40b8-80e6-1886a4f20c44", "content-length": "26", "date": "Thu, 24 Oct 2024 19:02:28 GMT"} })
23432024-10-24T19:02:28.628ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1118 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
23442024-10-24T19:02:28.629ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1150 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
23452024-10-24T19:02:28.630ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1150 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674
23462024-10-24T19:02:28.642ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
23472024-10-24T19:02:28.642ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
23482024-10-24T19:02:28.642ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 107.464027ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
23492024-10-24T19:02:28.650ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 115.300797ms iteration = 18 status = {"physical_disks_added":0}
23502024-10-24T19:02:28.667ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23512024-10-24T19:02:28.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23522024-10-24T19:02:28.683ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 149.879781ms iteration = 16 status = {}
23532024-10-24T19:02:28.688ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
23542024-10-24T19:02:28.688ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc7dd919-82e9-4bba-b4ec-82c76cf178e7", "content-length": "2", "date": "Thu, 24 Oct 2024 19:02:27 GMT"} })
23552024-10-24T19:02:28.690ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
23562024-10-24T19:02:28.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
23572024-10-24T19:02:28.692ZINFOnexus (BackgroundTasks): VPC route manager sled 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
23582024-10-24T19:02:28.692ZDEBGnexus (BackgroundTasks): client request SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
23592024-10-24T19:02:28.692ZDEBGnexus (BackgroundTasks): client response SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "7dc6feb2-08d5-45cc-806b-a61d7f1ab1d1", "content-length": "372", "date": "Thu, 24 Oct 2024 19:02:28 GMT"} })
23602024-10-24T19:02:28.692ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23612024-10-24T19:02:28.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23622024-10-24T19:02:28.693ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23632024-10-24T19:02:28.694ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 160.094767ms iteration = 16 status = null
23642024-10-24T19:02:28.694ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
23652024-10-24T19:02:28.694ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23662024-10-24T19:02:28.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23672024-10-24T19:02:28.727ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23682024-10-24T19:02:28.729ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
23692024-10-24T19:02:28.729ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23702024-10-24T19:02:28.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23712024-10-24T19:02:28.737ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
23722024-10-24T19:02:28.737ZDEBGnexus (BackgroundTasks): client request SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
23732024-10-24T19:02:28.737ZDEBGnexus (BackgroundTasks): client response SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "791189f3-e6a7-41b4-a53d-fed2fa586b32", "date": "Thu, 24 Oct 2024 19:02:28 GMT"} })
23742024-10-24T19:02:28.737ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23752024-10-24T19:02:28.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23762024-10-24T19:02:28.739ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23772024-10-24T19:02:28.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23782024-10-24T19:02:28.742ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23792024-10-24T19:02:28.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23802024-10-24T19:02:28.745ZINFOnexus (BackgroundTasks): VPC route manager sled 8ed5384f-0099-459e-a18a-fdd93abd3452 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
23812024-10-24T19:02:28.745ZDEBGnexus (BackgroundTasks): client request SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
23822024-10-24T19:02:28.746ZDEBGnexus (BackgroundTasks): client response SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d223566d-abc6-4a1b-9e37-9aec743fd8b7", "date": "Thu, 24 Oct 2024 19:02:28 GMT"} })
23832024-10-24T19:02:28.748ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 213.146056ms iteration = 17 status = {}
23842024-10-24T19:02:28.753ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23852024-10-24T19:02:28.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23862024-10-24T19:02:28.759ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 95766534-d8e7-4baf-bb18-72c7cf344605, rack_id: d6d74c37-fa13-4dad-8a2e-066574b53674, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(d796208a-628d-40ec-83c5-b72b8cbc0e00) } rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 switch_location = Switch0
23872024-10-24T19:02:28.759ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23882024-10-24T19:02:28.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23892024-10-24T19:02:28.769ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
23902024-10-24T19:02:28.769ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "3868b792-d48b-4a25-a895-6deb75bc3794", "content-length": "121", "date": "Thu, 24 Oct 2024 19:02:27 GMT"} })
23912024-10-24T19:02:28.769ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
23922024-10-24T19:02:28.769ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = d796208a-628d-40ec-83c5-b72b8cbc0e00
23932024-10-24T19:02:28.770ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
23942024-10-24T19:02:28.770ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
23952024-10-24T19:02:28.770ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
23962024-10-24T19:02:28.770ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
23972024-10-24T19:02:28.770ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
23982024-10-24T19:02:28.770ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
23992024-10-24T19:02:28.770ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24002024-10-24T19:02:28.770ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
24012024-10-24T19:02:28.770ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674
24022024-10-24T19:02:28.770ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24032024-10-24T19:02:28.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24042024-10-24T19:02:28.773ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
24052024-10-24T19:02:28.773ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "9c300c24-71ec-44a2-a46f-59935f045adb", "content-length": "2", "date": "Thu, 24 Oct 2024 19:02:27 GMT"} })
24062024-10-24T19:02:28.773ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
24072024-10-24T19:02:28.773ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "93c0bfc3-c7b8-4fee-8212-2debd9d75064", "content-length": "52", "date": "Thu, 24 Oct 2024 19:02:27 GMT"} })
24082024-10-24T19:02:28.773ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 switch_location = Switch0
24092024-10-24T19:02:28.773ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
24102024-10-24T19:02:28.821ZDEBGnexus (BackgroundTasks): client request SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
24112024-10-24T19:02:28.893ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "da2cc2f1-c36f-461d-ad3c-216a033c9553", "date": "Thu, 24 Oct 2024 19:02:28 GMT"} })
24122024-10-24T19:02:28.893ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 switch = Switch0
24132024-10-24T19:02:28.893ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
24142024-10-24T19:02:28.894ZDEBGnexus (BackgroundTasks): client response SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "53678fc3-898b-4ae6-98cc-0877769a43d5", "content-length": "691", "date": "Thu, 24 Oct 2024 19:02:28 GMT"} })
24152024-10-24T19:02:28.894ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "50de8c41-ae57-4918-8988-f871a208568d", "content-length": "669", "date": "Thu, 24 Oct 2024 19:02:28 GMT"} })
24162024-10-24T19:02:28.894ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
24172024-10-24T19:02:28.894ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
24182024-10-24T19:02:28.894ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
24192024-10-24T19:02:28.894ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24202024-10-24T19:02:28.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24212024-10-24T19:02:28.895ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 360.629399ms iteration = 17 status = {}
24222024-10-24T19:02:28.897ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24232024-10-24T19:02:28.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24242024-10-24T19:02:28.900ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24252024-10-24T19:02:28.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24262024-10-24T19:02:28.903ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24272024-10-24T19:02:28.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24282024-10-24T19:02:28.911ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 375.722582ms iteration = 16 status = {}
24292024-10-24T19:02:28.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = e3ef88df-57d6-4326-a9b3-0779ade5af30 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
24302024-10-24T19:02:28.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = e3ef88df-57d6-4326-a9b3-0779ade5af30 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
24312024-10-24T19:02:28.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 5101 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = e3ef88df-57d6-4326-a9b3-0779ade5af30 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
24322024-10-24T19:02:29.479ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 479 local_addr = [fd00:1122:3344:101::b]:60338 method = GET remote_addr = [fd00:1122:3344:101::d]:39079 req_id = 2d2d821f-aaeb-4f6b-8d3f-9de984a0d29a response_code = 200 uri = /51c1446e-49e7-4598-8832-f33ccdf3c076
24332024-10-24T19:02:29.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = c9468404-edb2-48e7-92fa-135e5c47f082 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
24342024-10-24T19:02:29.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = c9468404-edb2-48e7-92fa-135e5c47f082 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
24352024-10-24T19:02:29.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2304 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = c9468404-edb2-48e7-92fa-135e5c47f082 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
24362024-10-24T19:02:30.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 7a173556-1c59-48f7-8e04-8a55c48eedb2 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
24372024-10-24T19:02:30.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 7a173556-1c59-48f7-8e04-8a55c48eedb2 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
24382024-10-24T19:02:30.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2118 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 7a173556-1c59-48f7-8e04-8a55c48eedb2 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
24392024-10-24T19:02:31.984ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = ddfcd2ae-d1f4-4845-b4d4-a20baa7d4ba9 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
24402024-10-24T19:02:31.984ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = ddfcd2ae-d1f4-4845-b4d4-a20baa7d4ba9 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
24412024-10-24T19:02:31.987ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2603 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = ddfcd2ae-d1f4-4845-b4d4-a20baa7d4ba9 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
24422024-10-24T19:02:33.010ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 48c71587-0f23-44b5-92d4-c976b911fa42 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
24432024-10-24T19:02:33.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 48c71587-0f23-44b5-92d4-c976b911fa42 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
24442024-10-24T19:02:33.012ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2989 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 48c71587-0f23-44b5-92d4-c976b911fa42 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
24452024-10-24T19:02:34.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 96ba00e5-e276-40e8-a6f6-40276033121b roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
24462024-10-24T19:02:34.035ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 96ba00e5-e276-40e8-a6f6-40276033121b resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
24472024-10-24T19:02:34.037ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2273 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 96ba00e5-e276-40e8-a6f6-40276033121b response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
24482024-10-24T19:02:35.057ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 75bb1baa-ddb4-4c1d-b0dd-5bf989c5e72e roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
24492024-10-24T19:02:35.057ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 75bb1baa-ddb4-4c1d-b0dd-5bf989c5e72e resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
24502024-10-24T19:02:35.059ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2244 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 75bb1baa-ddb4-4c1d-b0dd-5bf989c5e72e response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
24512024-10-24T19:02:36.080ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = ce373db1-98dd-4c2f-ad6e-5cc972a68b89 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
24522024-10-24T19:02:36.080ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = ce373db1-98dd-4c2f-ad6e-5cc972a68b89 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
24532024-10-24T19:02:36.083ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2675 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = ce373db1-98dd-4c2f-ad6e-5cc972a68b89 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
24542024-10-24T19:02:37.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = ac1bba8d-92e2-4790-a021-f283fb486337 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
24552024-10-24T19:02:37.103ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = ac1bba8d-92e2-4790-a021-f283fb486337 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
24562024-10-24T19:02:37.105ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2630 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = ac1bba8d-92e2-4790-a021-f283fb486337 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
24572024-10-24T19:02:38.126ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 12ee68cf-b752-4c1c-9d57-d4cf0084915c roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
24582024-10-24T19:02:38.126ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 12ee68cf-b752-4c1c-9d57-d4cf0084915c resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
24592024-10-24T19:02:38.128ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2444 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 12ee68cf-b752-4c1c-9d57-d4cf0084915c response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
24602024-10-24T19:02:38.534ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
24612024-10-24T19:02:38.534ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24622024-10-24T19:02:38.534ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
24632024-10-24T19:02:38.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24642024-10-24T19:02:38.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24652024-10-24T19:02:38.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24662024-10-24T19:02:38.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24672024-10-24T19:02:38.564ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24682024-10-24T19:02:38.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24692024-10-24T19:02:38.567ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
24702024-10-24T19:02:38.567ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24712024-10-24T19:02:38.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24722024-10-24T19:02:38.568ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24732024-10-24T19:02:38.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24742024-10-24T19:02:38.570ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24752024-10-24T19:02:38.572ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: fbb59198-7d6e-40d8-9b05-3fd3707f9c53, lookup_type: ById(fbb59198-7d6e-40d8-9b05-3fd3707f9c53) } result = Ok(())
24762024-10-24T19:02:38.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24772024-10-24T19:02:38.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24782024-10-24T19:02:38.582ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = fbb59198-7d6e-40d8-9b05-3fd3707f9c53 original_time_created = 2024-10-24 18:54:46.689131 UTC target_id = fbb59198-7d6e-40d8-9b05-3fd3707f9c53 time_created = 2024-10-24 18:54:46.689131 UTC
24792024-10-24T19:02:38.582ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 47.445552ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"fbb59198-7d6e-40d8-9b05-3fd3707f9c53","time_created":"2024-10-24T18:54:46.689131Z"}
24802024-10-24T19:02:38.592ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.912092ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
24812024-10-24T19:02:39.148ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = ec04be49-0620-4b48-ba7d-4fd89888fdf6 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
24822024-10-24T19:02:39.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = ec04be49-0620-4b48-ba7d-4fd89888fdf6 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
24832024-10-24T19:02:39.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2037 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = ec04be49-0620-4b48-ba7d-4fd89888fdf6 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
24842024-10-24T19:02:39.480ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 833 local_addr = [fd00:1122:3344:101::b]:60338 method = GET remote_addr = [fd00:1122:3344:101::d]:39079 req_id = 9db4eaa1-16b8-436f-9e7f-882c342f6027 response_code = 200 uri = /51c1446e-49e7-4598-8832-f33ccdf3c076
24852024-10-24T19:02:40.171ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 80b4663a-8ae5-4b02-89a7-30bbe747d651 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
24862024-10-24T19:02:40.172ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 80b4663a-8ae5-4b02-89a7-30bbe747d651 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
24872024-10-24T19:02:40.173ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2093 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 80b4663a-8ae5-4b02-89a7-30bbe747d651 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
24882024-10-24T19:02:41.193ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 2f165f07-036b-4d0f-a76a-8db04fd4a187 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
24892024-10-24T19:02:41.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 2f165f07-036b-4d0f-a76a-8db04fd4a187 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
24902024-10-24T19:02:41.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3005 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 2f165f07-036b-4d0f-a76a-8db04fd4a187 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
24912024-10-24T19:02:42.216ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 782216b9-66fa-457a-ba2c-535c1a68c221 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
24922024-10-24T19:02:42.217ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 782216b9-66fa-457a-ba2c-535c1a68c221 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
24932024-10-24T19:02:42.219ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2503 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 782216b9-66fa-457a-ba2c-535c1a68c221 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
24942024-10-24T19:02:43.239ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 163493f6-f8af-41c9-95d1-4db89927e6b1 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
24952024-10-24T19:02:43.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 163493f6-f8af-41c9-95d1-4db89927e6b1 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
24962024-10-24T19:02:43.242ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2354 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 163493f6-f8af-41c9-95d1-4db89927e6b1 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
24972024-10-24T19:02:44.263ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 532ec5ab-4e26-4087-b7cd-959357bdf974 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
24982024-10-24T19:02:44.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 532ec5ab-4e26-4087-b7cd-959357bdf974 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
24992024-10-24T19:02:44.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2425 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 532ec5ab-4e26-4087-b7cd-959357bdf974 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
25002024-10-24T19:02:45.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 6a094501-702b-4c77-923f-58c141bc027e roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
25012024-10-24T19:02:45.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 6a094501-702b-4c77-923f-58c141bc027e resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
25022024-10-24T19:02:45.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2070 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 6a094501-702b-4c77-923f-58c141bc027e response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
25032024-10-24T19:02:46.307ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 34f2000f-60b7-41e4-9215-00fad7724107 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
25042024-10-24T19:02:46.308ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 34f2000f-60b7-41e4-9215-00fad7724107 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
25052024-10-24T19:02:46.310ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2333 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 34f2000f-60b7-41e4-9215-00fad7724107 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
25062024-10-24T19:02:47.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = f191093e-9cb5-4654-91a4-3cce9a60bf99 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
25072024-10-24T19:02:47.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = f191093e-9cb5-4654-91a4-3cce9a60bf99 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
25082024-10-24T19:02:47.333ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2706 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = f191093e-9cb5-4654-91a4-3cce9a60bf99 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
25092024-10-24T19:02:48.353ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = e5ef5fae-793f-4232-8cd0-7462b1c2071c roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
25102024-10-24T19:02:48.354ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = e5ef5fae-793f-4232-8cd0-7462b1c2071c resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
25112024-10-24T19:02:48.356ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2744 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = e5ef5fae-793f-4232-8cd0-7462b1c2071c response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
25122024-10-24T19:02:48.534ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
25132024-10-24T19:02:48.534ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
25142024-10-24T19:02:48.534ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25152024-10-24T19:02:48.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25162024-10-24T19:02:48.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25172024-10-24T19:02:48.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25182024-10-24T19:02:48.566ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25192024-10-24T19:02:48.567ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25202024-10-24T19:02:48.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25212024-10-24T19:02:48.568ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25222024-10-24T19:02:48.569ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25232024-10-24T19:02:48.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25242024-10-24T19:02:48.571ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25252024-10-24T19:02:48.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25262024-10-24T19:02:48.573ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25272024-10-24T19:02:48.575ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: fbb59198-7d6e-40d8-9b05-3fd3707f9c53, lookup_type: ById(fbb59198-7d6e-40d8-9b05-3fd3707f9c53) } result = Ok(())
25282024-10-24T19:02:48.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25292024-10-24T19:02:48.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25302024-10-24T19:02:48.583ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = fbb59198-7d6e-40d8-9b05-3fd3707f9c53 original_time_created = 2024-10-24 18:54:46.689131 UTC target_id = fbb59198-7d6e-40d8-9b05-3fd3707f9c53 time_created = 2024-10-24 18:54:46.689131 UTC
25312024-10-24T19:02:48.583ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.221628ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"fbb59198-7d6e-40d8-9b05-3fd3707f9c53","time_created":"2024-10-24T18:54:46.689131Z"}
25322024-10-24T19:02:48.595ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.019551ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25332024-10-24T19:02:49.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 1214d536-29b5-40b8-8edb-e9ba3acc2629 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
25342024-10-24T19:02:49.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 1214d536-29b5-40b8-8edb-e9ba3acc2629 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
25352024-10-24T19:02:49.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1942 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 1214d536-29b5-40b8-8edb-e9ba3acc2629 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
25362024-10-24T19:02:49.480ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 564 local_addr = [fd00:1122:3344:101::b]:60338 method = GET remote_addr = [fd00:1122:3344:101::d]:39079 req_id = 477ff407-9ce4-4254-bec8-a0db8986108d response_code = 200 uri = /51c1446e-49e7-4598-8832-f33ccdf3c076
25372024-10-24T19:02:50.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 359c47e4-d246-4a52-94fb-d6a366fa7d04 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
25382024-10-24T19:02:50.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 359c47e4-d246-4a52-94fb-d6a366fa7d04 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
25392024-10-24T19:02:50.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2912 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 359c47e4-d246-4a52-94fb-d6a366fa7d04 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
25402024-10-24T19:02:51.421ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = abfc4bfd-62e1-430e-a860-2779e793155e roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
25412024-10-24T19:02:51.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = abfc4bfd-62e1-430e-a860-2779e793155e resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
25422024-10-24T19:02:51.424ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2704 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = abfc4bfd-62e1-430e-a860-2779e793155e response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
25432024-10-24T19:02:52.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 3b91bb61-ddcf-4bc0-b85d-9d9569e639ca roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
25442024-10-24T19:02:52.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 3b91bb61-ddcf-4bc0-b85d-9d9569e639ca resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
25452024-10-24T19:02:52.446ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2126 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 3b91bb61-ddcf-4bc0-b85d-9d9569e639ca response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
25462024-10-24T19:02:53.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = a4364512-d606-4642-8684-5cb373a30de7 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
25472024-10-24T19:02:53.467ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = a4364512-d606-4642-8684-5cb373a30de7 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
25482024-10-24T19:02:53.469ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2269 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = a4364512-d606-4642-8684-5cb373a30de7 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
25492024-10-24T19:02:54.488ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 90edb75c-1403-44de-b5c8-c159ed2cdc78 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
25502024-10-24T19:02:54.489ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 90edb75c-1403-44de-b5c8-c159ed2cdc78 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
25512024-10-24T19:02:54.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4895 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 90edb75c-1403-44de-b5c8-c159ed2cdc78 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
25522024-10-24T19:02:55.514ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 3e72bc17-64dc-4844-b1b6-c5278445232c roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
25532024-10-24T19:02:55.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 3e72bc17-64dc-4844-b1b6-c5278445232c resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
25542024-10-24T19:02:55.516ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2621 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 3e72bc17-64dc-4844-b1b6-c5278445232c response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
25552024-10-24T19:02:56.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 4ac6d9cf-ddff-4a84-8b93-7b4812df3749 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
25562024-10-24T19:02:56.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 4ac6d9cf-ddff-4a84-8b93-7b4812df3749 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
25572024-10-24T19:02:56.538ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2131 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 4ac6d9cf-ddff-4a84-8b93-7b4812df3749 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
25582024-10-24T19:02:57.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = ba98a598-86f6-41a2-a4d2-2f1e244b1f4f roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
25592024-10-24T19:02:57.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = ba98a598-86f6-41a2-a4d2-2f1e244b1f4f resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
25602024-10-24T19:02:57.560ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2044 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = ba98a598-86f6-41a2-a4d2-2f1e244b1f4f response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
25612024-10-24T19:02:57.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59130 req_id = f43025bf-b4f7-4e4e-93a3-9d56348d6868 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
25622024-10-24T19:02:57.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59130 req_id = f43025bf-b4f7-4e4e-93a3-9d56348d6868 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
25632024-10-24T19:02:57.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2673 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59130 req_id = f43025bf-b4f7-4e4e-93a3-9d56348d6868 response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
25642024-10-24T19:02:58.534ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
25652024-10-24T19:02:58.534ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
25662024-10-24T19:02:58.534ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25672024-10-24T19:02:58.534ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
25682024-10-24T19:02:58.534ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
25692024-10-24T19:02:58.534ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
25702024-10-24T19:02:58.534ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
25712024-10-24T19:02:58.534ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
25722024-10-24T19:02:58.534ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
25732024-10-24T19:02:58.534ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-10-24 18:52:58.534158330 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
25742024-10-24T19:02:58.534ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
25752024-10-24T19:02:58.534ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
25762024-10-24T19:02:58.534ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
25772024-10-24T19:02:58.534ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
25782024-10-24T19:02:58.534ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25792024-10-24T19:02:58.534ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
25802024-10-24T19:02:58.534ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
25812024-10-24T19:02:58.534ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
25822024-10-24T19:02:58.534ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
25832024-10-24T19:02:58.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
25842024-10-24T19:02:58.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
25852024-10-24T19:02:58.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
25862024-10-24T19:02:58.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
25872024-10-24T19:02:58.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
25882024-10-24T19:02:58.534ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
25892024-10-24T19:02:58.534ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25902024-10-24T19:02:58.534ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
25912024-10-24T19:02:58.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25922024-10-24T19:02:58.534ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
25932024-10-24T19:02:58.534ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 7.74\u{b5}s iteration = 17 status = {"errors":[],"records_set_to_done":[]}
25942024-10-24T19:02:58.534ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
25952024-10-24T19:02:58.534ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
25962024-10-24T19:02:58.534ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
25972024-10-24T19:02:58.534ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
25982024-10-24T19:02:58.534ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
25992024-10-24T19:02:58.534ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
26002024-10-24T19:02:58.534ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 8.73\u{b5}s iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
26012024-10-24T19:02:58.534ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 6.41\u{b5}s iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
26022024-10-24T19:02:58.534ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
26032024-10-24T19:02:58.534ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
26042024-10-24T19:02:58.534ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26052024-10-24T19:02:58.534ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
26062024-10-24T19:02:58.534ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = fbb59198-7d6e-40d8-9b05-3fd3707f9c53
26072024-10-24T19:02:58.534ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
26082024-10-24T19:02:58.534ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
26092024-10-24T19:02:58.534ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.45\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"fbb59198-7d6e-40d8-9b05-3fd3707f9c53"}
26102024-10-24T19:02:58.534ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
26112024-10-24T19:02:58.534ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
26122024-10-24T19:02:58.534ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
26132024-10-24T19:02:58.534ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26142024-10-24T19:02:58.534ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26152024-10-24T19:02:58.534ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26162024-10-24T19:02:58.534ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
26172024-10-24T19:02:58.535ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
26182024-10-24T19:02:58.535ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
26192024-10-24T19:02:58.535ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
26202024-10-24T19:02:58.535ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
26212024-10-24T19:02:58.535ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
26222024-10-24T19:02:58.535ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
26232024-10-24T19:02:58.535ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
26242024-10-24T19:02:58.535ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26252024-10-24T19:02:58.535ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
26262024-10-24T19:02:58.535ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 10.72\u{b5}s iteration = 17 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
26272024-10-24T19:02:58.535ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
26282024-10-24T19:02:58.535ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
26292024-10-24T19:02:58.535ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
26302024-10-24T19:02:58.535ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
26312024-10-24T19:02:58.535ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26322024-10-24T19:02:58.535ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b130f689-a354-4ce5-be2b-20413d917375.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e40b6155-d379-4874-9119-51a498c972c1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e40b6155-d379-4874-9119-51a498c972c1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 3421, tv_nsec: 898184037 } })
26332024-10-24T19:02:58.535ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("06542437-1810-4294-a723-9ed308666b19.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("26818eb7-96aa-486e-ac98-9a5f4e70076d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d4b09213-5961-4095-a130-f1ddc420cb29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d4b09213-5961-4095-a130-f1ddc420cb29.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 3421, tv_nsec: 898205387 } })
26342024-10-24T19:02:58.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
26352024-10-24T19:02:58.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26362024-10-24T19:02:58.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
26372024-10-24T19:02:58.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26382024-10-24T19:02:58.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
26392024-10-24T19:02:58.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
26402024-10-24T19:02:58.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
26412024-10-24T19:02:58.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
26422024-10-24T19:02:58.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
26432024-10-24T19:02:58.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26442024-10-24T19:02:58.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
26452024-10-24T19:02:58.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26462024-10-24T19:02:58.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26472024-10-24T19:02:58.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26482024-10-24T19:02:58.535ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
26492024-10-24T19:02:58.535ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.32016ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
26502024-10-24T19:02:58.535ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
26512024-10-24T19:02:58.535ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.445602ms iteration = 9 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
26522024-10-24T19:02:58.536ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26532024-10-24T19:02:58.536ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
26542024-10-24T19:02:58.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26552024-10-24T19:02:58.537ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-10-24 18:52:58.534158330 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
26562024-10-24T19:02:58.537ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.390012ms iteration = 9 status = {"expiration":"2024-10-24T18:52:58.534158330Z","pruned":[]}
26572024-10-24T19:02:58.538ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
26582024-10-24T19:02:58.538ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
26592024-10-24T19:02:58.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
26602024-10-24T19:02:58.538ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8ed5384f-0099-459e-a18a-fdd93abd3452.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8ed5384f-0099-459e-a18a-fdd93abd3452.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3421, tv_nsec: 901643400 } })
26612024-10-24T19:02:58.538ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8ed5384f-0099-459e-a18a-fdd93abd3452.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8ed5384f-0099-459e-a18a-fdd93abd3452.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3421, tv_nsec: 901851894 } })
26622024-10-24T19:02:58.538ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1105
26632024-10-24T19:02:58.538ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1105
26642024-10-24T19:02:58.538ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
26652024-10-24T19:02:58.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
26662024-10-24T19:02:58.541ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26672024-10-24T19:02:58.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26682024-10-24T19:02:58.542ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 7.637868ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
26692024-10-24T19:02:58.542ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 8.022863ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
26702024-10-24T19:02:58.544ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26712024-10-24T19:02:58.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26722024-10-24T19:02:58.546ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
26732024-10-24T19:02:58.546ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
26742024-10-24T19:02:58.546ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 11.266214ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
26752024-10-24T19:02:58.547ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
26762024-10-24T19:02:58.547ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
26772024-10-24T19:02:58.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
26782024-10-24T19:02:58.548ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
26792024-10-24T19:02:58.548ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26802024-10-24T19:02:58.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26812024-10-24T19:02:58.551ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26822024-10-24T19:02:58.551ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26832024-10-24T19:02:58.551ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
26842024-10-24T19:02:58.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
26852024-10-24T19:02:58.553ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
26862024-10-24T19:02:58.553ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26872024-10-24T19:02:58.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26882024-10-24T19:02:58.554ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 19.922936ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
26892024-10-24T19:02:58.556ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
26902024-10-24T19:02:58.558ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26912024-10-24T19:02:58.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26922024-10-24T19:02:58.560ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8ed5384f-0099-459e-a18a-fdd93abd3452.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8ed5384f-0099-459e-a18a-fdd93abd3452.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3421, tv_nsec: 923900323 } })
26932024-10-24T19:02:58.561ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1105 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674
26942024-10-24T19:02:58.577ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26952024-10-24T19:02:58.579ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
26962024-10-24T19:02:58.579ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26972024-10-24T19:02:58.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26982024-10-24T19:02:58.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 6e4b9b6a-f493-4d65-8c5a-1d553f44bbcf roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
26992024-10-24T19:02:58.581ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
27002024-10-24T19:02:58.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 6e4b9b6a-f493-4d65-8c5a-1d553f44bbcf resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
27012024-10-24T19:02:58.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
27022024-10-24T19:02:58.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2428 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 6e4b9b6a-f493-4d65-8c5a-1d553f44bbcf response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
27032024-10-24T19:02:58.584ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 49.32529ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
27042024-10-24T19:02:58.586ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
27052024-10-24T19:02:58.586ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
27062024-10-24T19:02:58.586ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
27072024-10-24T19:02:58.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
27082024-10-24T19:02:58.589ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27092024-10-24T19:02:58.589ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27102024-10-24T19:02:58.591ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
27112024-10-24T19:02:58.591ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
27122024-10-24T19:02:58.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
27132024-10-24T19:02:58.593ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
27142024-10-24T19:02:58.597ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27152024-10-24T19:02:58.597ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27162024-10-24T19:02:58.599ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
27172024-10-24T19:02:58.599ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27182024-10-24T19:02:58.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27192024-10-24T19:02:58.600ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
27202024-10-24T19:02:58.600ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27212024-10-24T19:02:58.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27222024-10-24T19:02:58.601ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27232024-10-24T19:02:58.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27242024-10-24T19:02:58.602ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27252024-10-24T19:02:58.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27262024-10-24T19:02:58.602ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27272024-10-24T19:02:58.604ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
27282024-10-24T19:02:58.604ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
27292024-10-24T19:02:58.604ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
27302024-10-24T19:02:58.604ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
27312024-10-24T19:02:58.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
27322024-10-24T19:02:58.605ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
27332024-10-24T19:02:58.605ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
27342024-10-24T19:02:58.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27352024-10-24T19:02:58.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
27362024-10-24T19:02:58.606ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27372024-10-24T19:02:58.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: fbb59198-7d6e-40d8-9b05-3fd3707f9c53, lookup_type: ById(fbb59198-7d6e-40d8-9b05-3fd3707f9c53) } result = Ok(())
27382024-10-24T19:02:58.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27392024-10-24T19:02:58.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27402024-10-24T19:02:58.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
27412024-10-24T19:02:58.610ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
27422024-10-24T19:02:58.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
27432024-10-24T19:02:58.611ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
27442024-10-24T19:02:58.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
27452024-10-24T19:02:58.611ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
27462024-10-24T19:02:58.611ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
27472024-10-24T19:02:58.611ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 76.953736ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
27482024-10-24T19:02:58.620ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27492024-10-24T19:02:58.623ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
27502024-10-24T19:02:58.623ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27512024-10-24T19:02:58.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27522024-10-24T19:02:58.635ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = fbb59198-7d6e-40d8-9b05-3fd3707f9c53 original_time_created = 2024-10-24 18:54:46.689131 UTC target_id = fbb59198-7d6e-40d8-9b05-3fd3707f9c53 time_created = 2024-10-24 18:54:46.689131 UTC
27532024-10-24T19:02:58.635ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 100.681423ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"fbb59198-7d6e-40d8-9b05-3fd3707f9c53","time_created":"2024-10-24T18:54:46.689131Z"}
27542024-10-24T19:02:58.640ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
27552024-10-24T19:02:58.640ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
27562024-10-24T19:02:58.640ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
27572024-10-24T19:02:58.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
27582024-10-24T19:02:58.641ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
27592024-10-24T19:02:58.641ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
27602024-10-24T19:02:58.641ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
27612024-10-24T19:02:58.641ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
27622024-10-24T19:02:58.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
27632024-10-24T19:02:58.642ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
27642024-10-24T19:02:58.642ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 108.065916ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
27652024-10-24T19:02:58.643ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
27662024-10-24T19:02:58.643ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
27672024-10-24T19:02:58.643ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 108.306299ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
27682024-10-24T19:02:58.643ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27692024-10-24T19:02:58.645ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27702024-10-24T19:02:58.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27712024-10-24T19:02:58.646ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
27722024-10-24T19:02:58.647ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
27732024-10-24T19:02:58.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
27742024-10-24T19:02:58.647ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27752024-10-24T19:02:58.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27762024-10-24T19:02:58.650ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27772024-10-24T19:02:58.653ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
27782024-10-24T19:02:58.653ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27792024-10-24T19:02:58.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27802024-10-24T19:02:58.658ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
27812024-10-24T19:02:58.658ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 40d8768c-5b67-41c8-8a5f-c7782dbfc898 dns_zone_name = oxide.test found_so_far = 0 version = 2
27822024-10-24T19:02:58.658ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
27832024-10-24T19:02:58.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
27842024-10-24T19:02:58.659ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
27852024-10-24T19:02:58.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
27862024-10-24T19:02:58.661ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27872024-10-24T19:02:58.665ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
27882024-10-24T19:02:58.665ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
27892024-10-24T19:02:58.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
27902024-10-24T19:02:58.667ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 40d8768c-5b67-41c8-8a5f-c7782dbfc898 dns_zone_name = oxide.test found_so_far = 1 version = 2
27912024-10-24T19:02:58.667ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
27922024-10-24T19:02:58.667ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-10-24 18:55:01.522538 UTC dns_group = external generation = 2
27932024-10-24T19:02:58.668ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 133.841794ms iteration = 9 status = {"generation":2}
27942024-10-24T19:02:58.671ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27952024-10-24T19:02:58.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27962024-10-24T19:02:58.692ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27972024-10-24T19:02:58.696ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8ed5384f-0099-459e-a18a-fdd93abd3452, lookup_type: ById(8ed5384f-0099-459e-a18a-fdd93abd3452) } result = Ok(())
27982024-10-24T19:02:58.696ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27992024-10-24T19:02:58.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28002024-10-24T19:02:58.700ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 165.192586ms iteration = 17 status = 0
28012024-10-24T19:02:58.700ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
28022024-10-24T19:02:58.700ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 6ae7917d-db6c-4390-ad36-16f7cdab058b dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
28032024-10-24T19:02:58.700ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
28042024-10-24T19:02:58.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
28052024-10-24T19:02:58.702ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28062024-10-24T19:02:58.703ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28072024-10-24T19:02:58.703ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
28082024-10-24T19:02:58.706ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
28092024-10-24T19:02:58.706ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
28102024-10-24T19:02:58.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
28112024-10-24T19:02:58.706ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
28122024-10-24T19:02:58.706ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
28132024-10-24T19:02:58.707ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1113 zone_address = fd00:1122:3344:101::2
28142024-10-24T19:02:58.707ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28152024-10-24T19:02:58.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
28162024-10-24T19:02:58.707ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "24009704-a1ae-4900-9683-d874f0fdc732", "content-length": "26", "date": "Thu, 24 Oct 2024 19:02:58 GMT"} })
28172024-10-24T19:02:58.707ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1118 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28182024-10-24T19:02:58.710ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1150 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
28192024-10-24T19:02:58.710ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 6ae7917d-db6c-4390-ad36-16f7cdab058b dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
28202024-10-24T19:02:58.710ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
28212024-10-24T19:02:58.710ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-10-24 18:55:00.465937 UTC dns_group = internal generation = 1
28222024-10-24T19:02:58.710ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 176.704634ms iteration = 9 status = {"generation":1}
28232024-10-24T19:02:58.722ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1113 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 zone_address = fd00:1122:3344:101::2
28242024-10-24T19:02:58.722ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28252024-10-24T19:02:58.722ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e674a858-32b7-47dd-9cea-09d2b6f91709", "content-length": "26", "date": "Thu, 24 Oct 2024 19:02:58 GMT"} })
28262024-10-24T19:02:58.722ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1118 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28272024-10-24T19:02:58.725ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1150 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674
28282024-10-24T19:02:58.740ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
28292024-10-24T19:02:58.740ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 205.66151ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
28302024-10-24T19:02:58.752ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-10-24T18:54:56.514007Z, time_modified: 2024-10-24T18:54:56.514007Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 68627db6-53a8-4390-a3e6-e94f65d72ce7, db_silo: Silo { identity: SiloIdentity { id: 68627db6-53a8-4390-a3e6-e94f65d72ce7, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-24T18:55:01.468978Z, time_modified: 2024-10-24T18:55:01.468978Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "1c746763ac1d0b5e2ef2147ce9044dbc34dc4c4b966a58bca0aa0568eb6d1351" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 68627db6-53a8-4390-a3e6-e94f65d72ce7, db_silo: Silo { identity: SiloIdentity { id: 68627db6-53a8-4390-a3e6-e94f65d72ce7, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-24T18:55:01.468978Z, time_modified: 2024-10-24T18:55:01.468978Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "1c746763ac1d0b5e2ef2147ce9044dbc34dc4c4b966a58bca0aa0568eb6d1351" }] }) }
28312024-10-24T19:02:58.753ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 218.887814ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"68627db6-53a8-4390-a3e6-e94f65d72ce7","tls_certs":["1c746763ac1d0b5e2ef2147ce9044dbc34dc4c4b966a58bca0aa0568eb6d1351"]}},"default_endpoint":{"silo_id":"68627db6-53a8-4390-a3e6-e94f65d72ce7","tls_certs":["1c746763ac1d0b5e2ef2147ce9044dbc34dc4c4b966a58bca0aa0568eb6d1351"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
28322024-10-24T19:02:58.784ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 249.547957ms iteration = 19 status = {"physical_disks_added":0}
28332024-10-24T19:02:58.786ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
28342024-10-24T19:02:58.793ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28352024-10-24T19:02:58.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28362024-10-24T19:02:58.795ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28372024-10-24T19:02:58.796ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
28382024-10-24T19:02:58.796ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28392024-10-24T19:02:58.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28402024-10-24T19:02:58.840ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1113 zone_address = fd00:1122:3344:101::2
28412024-10-24T19:02:58.840ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28422024-10-24T19:02:58.840ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "83e35abd-b842-4d7e-aab6-ab3334416ed3", "content-length": "26", "date": "Thu, 24 Oct 2024 19:02:58 GMT"} })
28432024-10-24T19:02:58.840ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1118 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28442024-10-24T19:02:58.843ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1150 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
28452024-10-24T19:02:58.881ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
28462024-10-24T19:02:58.881ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "db49d980-0233-4a0f-aad6-adb733e18be4", "date": "Thu, 24 Oct 2024 19:02:58 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
28472024-10-24T19:02:58.881ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
28482024-10-24T19:02:58.884ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "5851f732-afbd-41af-8e20-88b6d3adb180", "date": "Thu, 24 Oct 2024 19:02:58 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
28492024-10-24T19:02:58.884ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
28502024-10-24T19:02:58.886ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
28512024-10-24T19:02:58.886ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 352.669726ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
28522024-10-24T19:02:58.894ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 360.837302ms iteration = 17 status = {}
28532024-10-24T19:02:58.949ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
28542024-10-24T19:02:59.077ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
28552024-10-24T19:02:59.077ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "ce5891f6-ab9b-46a2-98fc-dde17264b835", "date": "Thu, 24 Oct 2024 19:02:59 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
28562024-10-24T19:02:59.077ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
28572024-10-24T19:02:59.079ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "e2c90a6d-63cd-4ce4-b03b-8548d3e5e22d", "date": "Thu, 24 Oct 2024 19:02:59 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
28582024-10-24T19:02:59.079ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
28592024-10-24T19:02:59.081ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "c750bba5-05e4-43c8-a067-ed6e304ab42f", "date": "Thu, 24 Oct 2024 19:02:59 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
28602024-10-24T19:02:59.081ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
28612024-10-24T19:02:59.083ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
28622024-10-24T19:02:59.083ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 549.102244ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
28632024-10-24T19:02:59.087ZINFOnexus (BackgroundTasks): VPC route manager sled 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
28642024-10-24T19:02:59.087ZDEBGnexus (BackgroundTasks): client request SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
28652024-10-24T19:02:59.087ZDEBGnexus (BackgroundTasks): client response SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a7803195-c846-41e2-896f-74402b99b332", "content-length": "372", "date": "Thu, 24 Oct 2024 19:02:59 GMT"} })
28662024-10-24T19:02:59.087ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28672024-10-24T19:02:59.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28682024-10-24T19:02:59.089ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28692024-10-24T19:02:59.091ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
28702024-10-24T19:02:59.091ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28712024-10-24T19:02:59.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28722024-10-24T19:02:59.102ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
28732024-10-24T19:02:59.102ZDEBGnexus (BackgroundTasks): client request SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
28742024-10-24T19:02:59.102ZDEBGnexus (BackgroundTasks): client response SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e7a99081-9331-49e6-832f-dff994c56e97", "date": "Thu, 24 Oct 2024 19:02:59 GMT"} })
28752024-10-24T19:02:59.102ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28762024-10-24T19:02:59.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28772024-10-24T19:02:59.105ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28782024-10-24T19:02:59.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28792024-10-24T19:02:59.108ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28802024-10-24T19:02:59.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28812024-10-24T19:02:59.112ZINFOnexus (BackgroundTasks): VPC route manager sled 8ed5384f-0099-459e-a18a-fdd93abd3452 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
28822024-10-24T19:02:59.112ZDEBGnexus (BackgroundTasks): client request SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
28832024-10-24T19:02:59.112ZDEBGnexus (BackgroundTasks): client response SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "29fc5867-feb0-4936-a446-877be539710c", "date": "Thu, 24 Oct 2024 19:02:59 GMT"} })
28842024-10-24T19:02:59.114ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 579.641906ms iteration = 18 status = {}
28852024-10-24T19:02:59.117ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
28862024-10-24T19:02:59.117ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "23a90e7f-58f7-42cd-b026-212e834e3e20", "content-length": "2", "date": "Thu, 24 Oct 2024 19:02:58 GMT"} })
28872024-10-24T19:02:59.119ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
28882024-10-24T19:02:59.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
28892024-10-24T19:02:59.121ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 587.307733ms iteration = 17 status = null
28902024-10-24T19:02:59.182ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28912024-10-24T19:02:59.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28922024-10-24T19:02:59.197ZDEBGnexus (BackgroundTasks): client request SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
28932024-10-24T19:02:59.199ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 95766534-d8e7-4baf-bb18-72c7cf344605, rack_id: d6d74c37-fa13-4dad-8a2e-066574b53674, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(d796208a-628d-40ec-83c5-b72b8cbc0e00) } rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 switch_location = Switch0
28942024-10-24T19:02:59.199ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28952024-10-24T19:02:59.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28962024-10-24T19:02:59.208ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
28972024-10-24T19:02:59.208ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "d547e35a-15be-4c1b-b359-4df98859740e", "content-length": "121", "date": "Thu, 24 Oct 2024 19:02:59 GMT"} })
28982024-10-24T19:02:59.208ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
28992024-10-24T19:02:59.208ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = d796208a-628d-40ec-83c5-b72b8cbc0e00
29002024-10-24T19:02:59.209ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
29012024-10-24T19:02:59.209ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
29022024-10-24T19:02:59.209ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29032024-10-24T19:02:59.209ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29042024-10-24T19:02:59.209ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29052024-10-24T19:02:59.209ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
29062024-10-24T19:02:59.209ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29072024-10-24T19:02:59.209ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
29082024-10-24T19:02:59.209ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674
29092024-10-24T19:02:59.209ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29102024-10-24T19:02:59.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29112024-10-24T19:02:59.211ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
29122024-10-24T19:02:59.211ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "27785a17-3255-41bf-a76b-f08a01963e58", "content-length": "2", "date": "Thu, 24 Oct 2024 19:02:59 GMT"} })
29132024-10-24T19:02:59.211ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
29142024-10-24T19:02:59.211ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "aaf9a510-deba-44b1-92a1-b470cdc49111", "content-length": "52", "date": "Thu, 24 Oct 2024 19:02:59 GMT"} })
29152024-10-24T19:02:59.211ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 switch_location = Switch0
29162024-10-24T19:02:59.211ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
29172024-10-24T19:02:59.280ZDEBGnexus (BackgroundTasks): client response SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5caf0dd5-979f-4bc6-b6c5-881675cb1e28", "content-length": "691", "date": "Thu, 24 Oct 2024 19:02:59 GMT"} })
29182024-10-24T19:02:59.280ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
29192024-10-24T19:02:59.280ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
29202024-10-24T19:02:59.280ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
29212024-10-24T19:02:59.282ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 747.856978ms iteration = 18 status = {}
29222024-10-24T19:02:59.383ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "b7acbfda-9239-46ce-bbfe-93c4a7f6f90b", "date": "Thu, 24 Oct 2024 19:02:59 GMT"} })
29232024-10-24T19:02:59.383ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 switch = Switch0
29242024-10-24T19:02:59.383ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
29252024-10-24T19:02:59.389ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "50ec8aa3-61c7-464c-a089-3f3f7ba01f47", "content-length": "669", "date": "Thu, 24 Oct 2024 19:02:59 GMT"} })
29262024-10-24T19:02:59.389ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29272024-10-24T19:02:59.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29282024-10-24T19:02:59.393ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29292024-10-24T19:02:59.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29302024-10-24T19:02:59.396ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29312024-10-24T19:02:59.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29322024-10-24T19:02:59.399ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29332024-10-24T19:02:59.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29342024-10-24T19:02:59.406ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 871.84982ms iteration = 17 status = {}
29352024-10-24T19:02:59.480ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 443 local_addr = [fd00:1122:3344:101::b]:60338 method = GET remote_addr = [fd00:1122:3344:101::d]:39079 req_id = ee073b7a-129f-433c-9748-1aa158e920c0 response_code = 200 uri = /51c1446e-49e7-4598-8832-f33ccdf3c076
29362024-10-24T19:02:59.607ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = c6ac0f14-b112-4e71-b3b1-507471a733d3 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
29372024-10-24T19:02:59.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = c6ac0f14-b112-4e71-b3b1-507471a733d3 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
29382024-10-24T19:02:59.609ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2357 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = c6ac0f14-b112-4e71-b3b1-507471a733d3 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
29392024-10-24T19:03:00.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = d729bec2-68ec-4bef-87dc-6bd58162c7b6 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
29402024-10-24T19:03:00.628ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = d729bec2-68ec-4bef-87dc-6bd58162c7b6 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
29412024-10-24T19:03:00.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2613 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = d729bec2-68ec-4bef-87dc-6bd58162c7b6 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
29422024-10-24T19:03:01.651ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 480ef681-f6c6-4520-ac67-92d50e486206 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
29432024-10-24T19:03:01.651ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 480ef681-f6c6-4520-ac67-92d50e486206 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
29442024-10-24T19:03:01.653ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2544 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 480ef681-f6c6-4520-ac67-92d50e486206 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
29452024-10-24T19:03:02.674ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 4ed6e379-fef4-4d2a-8573-e0c59caafaca roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
29462024-10-24T19:03:02.674ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 4ed6e379-fef4-4d2a-8573-e0c59caafaca resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
29472024-10-24T19:03:02.676ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2777 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 4ed6e379-fef4-4d2a-8573-e0c59caafaca response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
29482024-10-24T19:03:03.697ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = c6103e4e-96bc-40e5-a236-1903e5f187b2 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
29492024-10-24T19:03:03.698ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = c6103e4e-96bc-40e5-a236-1903e5f187b2 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
29502024-10-24T19:03:03.699ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2023 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = c6103e4e-96bc-40e5-a236-1903e5f187b2 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
29512024-10-24T19:03:04.720ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = e172c35b-4c0c-4f0f-9fcd-a3c0a412e292 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
29522024-10-24T19:03:04.720ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = e172c35b-4c0c-4f0f-9fcd-a3c0a412e292 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
29532024-10-24T19:03:04.722ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2251 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = e172c35b-4c0c-4f0f-9fcd-a3c0a412e292 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
29542024-10-24T19:03:05.742ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = b4bff6e0-2b9d-428b-bfe2-259a8e01470c roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
29552024-10-24T19:03:05.743ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = b4bff6e0-2b9d-428b-bfe2-259a8e01470c resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
29562024-10-24T19:03:05.745ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2600 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = b4bff6e0-2b9d-428b-bfe2-259a8e01470c response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
29572024-10-24T19:03:06.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = d653aab6-6e2c-4b55-a09c-4bce31dc1924 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
29582024-10-24T19:03:06.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = d653aab6-6e2c-4b55-a09c-4bce31dc1924 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
29592024-10-24T19:03:06.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2617 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = d653aab6-6e2c-4b55-a09c-4bce31dc1924 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
29602024-10-24T19:03:07.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 3c44882b-4391-4617-b3de-5d45f00760a3 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
29612024-10-24T19:03:07.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 3c44882b-4391-4617-b3de-5d45f00760a3 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
29622024-10-24T19:03:07.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2353 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 3c44882b-4391-4617-b3de-5d45f00760a3 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
29632024-10-24T19:03:08.535ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
29642024-10-24T19:03:08.535ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
29652024-10-24T19:03:08.535ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29662024-10-24T19:03:08.535ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29672024-10-24T19:03:08.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29682024-10-24T19:03:08.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29692024-10-24T19:03:08.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29702024-10-24T19:03:08.540ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29712024-10-24T19:03:08.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29722024-10-24T19:03:08.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29732024-10-24T19:03:08.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29742024-10-24T19:03:08.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29752024-10-24T19:03:08.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29762024-10-24T19:03:08.546ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: fbb59198-7d6e-40d8-9b05-3fd3707f9c53, lookup_type: ById(fbb59198-7d6e-40d8-9b05-3fd3707f9c53) } result = Ok(())
29772024-10-24T19:03:08.546ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29782024-10-24T19:03:08.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29792024-10-24T19:03:08.554ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = fbb59198-7d6e-40d8-9b05-3fd3707f9c53 original_time_created = 2024-10-24 18:54:46.689131 UTC target_id = fbb59198-7d6e-40d8-9b05-3fd3707f9c53 time_created = 2024-10-24 18:54:46.689131 UTC
29802024-10-24T19:03:08.554ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.686398ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"fbb59198-7d6e-40d8-9b05-3fd3707f9c53","time_created":"2024-10-24T18:54:46.689131Z"}
29812024-10-24T19:03:08.564ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29822024-10-24T19:03:08.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29832024-10-24T19:03:08.597ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.011496ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29842024-10-24T19:03:08.812ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 0f9d5b4a-8387-4cc6-91d7-8463f2ebd4d5 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
29852024-10-24T19:03:08.812ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 0f9d5b4a-8387-4cc6-91d7-8463f2ebd4d5 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
29862024-10-24T19:03:08.814ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1828 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 0f9d5b4a-8387-4cc6-91d7-8463f2ebd4d5 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
29872024-10-24T19:03:09.481ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 918 local_addr = [fd00:1122:3344:101::b]:60338 method = GET remote_addr = [fd00:1122:3344:101::d]:39079 req_id = 625df385-5ecd-402c-b6a6-455ba32b07d7 response_code = 200 uri = /51c1446e-49e7-4598-8832-f33ccdf3c076
29882024-10-24T19:03:09.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = d2d1454e-0bd3-4b4a-8c79-ef6059a1d618 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
29892024-10-24T19:03:09.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = d2d1454e-0bd3-4b4a-8c79-ef6059a1d618 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
29902024-10-24T19:03:09.836ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2293 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = d2d1454e-0bd3-4b4a-8c79-ef6059a1d618 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
29912024-10-24T19:03:10.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = f9c34d51-3e83-4ff6-8b44-5f035d3647f7 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
29922024-10-24T19:03:10.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = f9c34d51-3e83-4ff6-8b44-5f035d3647f7 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
29932024-10-24T19:03:10.858ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2203 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = f9c34d51-3e83-4ff6-8b44-5f035d3647f7 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
29942024-10-24T19:03:11.880ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 775fd94d-4f6e-4069-b80c-51c094de1035 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
29952024-10-24T19:03:11.880ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 775fd94d-4f6e-4069-b80c-51c094de1035 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
29962024-10-24T19:03:11.882ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2303 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 775fd94d-4f6e-4069-b80c-51c094de1035 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
29972024-10-24T19:03:12.903ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 1413e21d-2d13-4ae8-8d5f-133fabc238bc roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
29982024-10-24T19:03:12.903ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 1413e21d-2d13-4ae8-8d5f-133fabc238bc resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
29992024-10-24T19:03:12.905ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1953 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 1413e21d-2d13-4ae8-8d5f-133fabc238bc response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
30002024-10-24T19:03:13.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = fc17990a-93ef-47f3-980e-f9b192b8f33c roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
30012024-10-24T19:03:13.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = fc17990a-93ef-47f3-980e-f9b192b8f33c resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
30022024-10-24T19:03:13.927ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2374 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = fc17990a-93ef-47f3-980e-f9b192b8f33c response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
30032024-10-24T19:03:14.948ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 67555c2a-7d3f-47a2-be79-93d7dcb670fe roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
30042024-10-24T19:03:14.949ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 67555c2a-7d3f-47a2-be79-93d7dcb670fe resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
30052024-10-24T19:03:14.950ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2140 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 67555c2a-7d3f-47a2-be79-93d7dcb670fe response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
30062024-10-24T19:03:15.970ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = ad2c5a1a-7770-4469-a516-824e6afc7560 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
30072024-10-24T19:03:15.971ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = ad2c5a1a-7770-4469-a516-824e6afc7560 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
30082024-10-24T19:03:15.973ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2224 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = ad2c5a1a-7770-4469-a516-824e6afc7560 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
30092024-10-24T19:03:16.993ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 75f9d8a0-01fa-4479-b787-e68f5643b93a roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
30102024-10-24T19:03:16.993ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 75f9d8a0-01fa-4479-b787-e68f5643b93a resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
30112024-10-24T19:03:16.995ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2118 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 75f9d8a0-01fa-4479-b787-e68f5643b93a response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
30122024-10-24T19:03:18.017ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = a07c1846-58b5-44b4-bd2f-d500ddbd70ef roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
30132024-10-24T19:03:18.017ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = a07c1846-58b5-44b4-bd2f-d500ddbd70ef resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
30142024-10-24T19:03:18.019ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2269 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = a07c1846-58b5-44b4-bd2f-d500ddbd70ef response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
30152024-10-24T19:03:18.535ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
30162024-10-24T19:03:18.535ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30172024-10-24T19:03:18.535ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
30182024-10-24T19:03:18.535ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30192024-10-24T19:03:18.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30202024-10-24T19:03:18.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30212024-10-24T19:03:18.538ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30222024-10-24T19:03:18.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30232024-10-24T19:03:18.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30242024-10-24T19:03:18.541ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
30252024-10-24T19:03:18.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30262024-10-24T19:03:18.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30272024-10-24T19:03:18.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30282024-10-24T19:03:18.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30292024-10-24T19:03:18.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30302024-10-24T19:03:18.547ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: fbb59198-7d6e-40d8-9b05-3fd3707f9c53, lookup_type: ById(fbb59198-7d6e-40d8-9b05-3fd3707f9c53) } result = Ok(())
30312024-10-24T19:03:18.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30322024-10-24T19:03:18.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30332024-10-24T19:03:18.558ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = fbb59198-7d6e-40d8-9b05-3fd3707f9c53 original_time_created = 2024-10-24 18:54:46.689131 UTC target_id = fbb59198-7d6e-40d8-9b05-3fd3707f9c53 time_created = 2024-10-24 18:54:46.689131 UTC
30342024-10-24T19:03:18.558ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.649479ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"fbb59198-7d6e-40d8-9b05-3fd3707f9c53","time_created":"2024-10-24T18:54:46.689131Z"}
30352024-10-24T19:03:18.565ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.091684ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30362024-10-24T19:03:19.039ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 01eab3ae-d4b8-410b-b49f-ec5b07923494 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
30372024-10-24T19:03:19.039ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 01eab3ae-d4b8-410b-b49f-ec5b07923494 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
30382024-10-24T19:03:19.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2367 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 01eab3ae-d4b8-410b-b49f-ec5b07923494 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
30392024-10-24T19:03:19.480ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 690 local_addr = [fd00:1122:3344:101::b]:60338 method = GET remote_addr = [fd00:1122:3344:101::d]:39079 req_id = 4e998a7b-a194-47e8-83ad-a2a5335a95c5 response_code = 200 uri = /51c1446e-49e7-4598-8832-f33ccdf3c076
30402024-10-24T19:03:20.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = b2827dff-7ce8-4dfa-9bde-646378f63500 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
30412024-10-24T19:03:20.063ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = b2827dff-7ce8-4dfa-9bde-646378f63500 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
30422024-10-24T19:03:20.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2014 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = b2827dff-7ce8-4dfa-9bde-646378f63500 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
30432024-10-24T19:03:21.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 3781d937-8c96-476f-ad94-0ef5bb596665 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
30442024-10-24T19:03:21.084ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 3781d937-8c96-476f-ad94-0ef5bb596665 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
30452024-10-24T19:03:21.087ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2920 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 3781d937-8c96-476f-ad94-0ef5bb596665 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
30462024-10-24T19:03:22.106ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = b5f33d84-1b5a-4317-b49b-0446403d28a6 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
30472024-10-24T19:03:22.106ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = b5f33d84-1b5a-4317-b49b-0446403d28a6 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
30482024-10-24T19:03:22.108ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1971 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = b5f33d84-1b5a-4317-b49b-0446403d28a6 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
30492024-10-24T19:03:23.127ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = da5d16d3-7087-4b22-bcb9-f22dcb4d5de2 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
30502024-10-24T19:03:23.127ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = da5d16d3-7087-4b22-bcb9-f22dcb4d5de2 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
30512024-10-24T19:03:23.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2209 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = da5d16d3-7087-4b22-bcb9-f22dcb4d5de2 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
30522024-10-24T19:03:24.150ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 0d6edc6a-9285-44b2-b40a-49955c0afaa9 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
30532024-10-24T19:03:24.150ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 0d6edc6a-9285-44b2-b40a-49955c0afaa9 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
30542024-10-24T19:03:24.152ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2189 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 0d6edc6a-9285-44b2-b40a-49955c0afaa9 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
30552024-10-24T19:03:25.174ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 33986ec0-e110-4032-aebb-f79a6dcf635d roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
30562024-10-24T19:03:25.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 33986ec0-e110-4032-aebb-f79a6dcf635d resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
30572024-10-24T19:03:25.177ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2632 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 33986ec0-e110-4032-aebb-f79a6dcf635d response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
30582024-10-24T19:03:26.196ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 8e76521d-7c43-417b-97fe-44992c3dbbc6 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
30592024-10-24T19:03:26.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 8e76521d-7c43-417b-97fe-44992c3dbbc6 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
30602024-10-24T19:03:26.199ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2759 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 8e76521d-7c43-417b-97fe-44992c3dbbc6 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
30612024-10-24T19:03:27.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = d3a610d6-c111-4f18-8ec6-5fff19fe39f6 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
30622024-10-24T19:03:27.220ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = d3a610d6-c111-4f18-8ec6-5fff19fe39f6 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
30632024-10-24T19:03:27.222ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2018 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = d3a610d6-c111-4f18-8ec6-5fff19fe39f6 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
30642024-10-24T19:03:27.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59130 req_id = a7cf015c-dc81-4ac7-b2a9-102684e7fe9b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
30652024-10-24T19:03:27.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59130 req_id = a7cf015c-dc81-4ac7-b2a9-102684e7fe9b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
30662024-10-24T19:03:27.631ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3924 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59130 req_id = a7cf015c-dc81-4ac7-b2a9-102684e7fe9b response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
30672024-10-24T19:03:28.242ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 8328a327-ba2f-42d5-9372-2a23038107f7 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
30682024-10-24T19:03:28.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 8328a327-ba2f-42d5-9372-2a23038107f7 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
30692024-10-24T19:03:28.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2738 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 8328a327-ba2f-42d5-9372-2a23038107f7 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
30702024-10-24T19:03:28.534ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
30712024-10-24T19:03:28.534ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
30722024-10-24T19:03:28.534ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
30732024-10-24T19:03:28.534ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
30742024-10-24T19:03:28.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
30752024-10-24T19:03:28.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
30762024-10-24T19:03:28.535ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
30772024-10-24T19:03:28.535ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
30782024-10-24T19:03:28.535ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30792024-10-24T19:03:28.535ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 11.61\u{b5}s iteration = 18 status = {"errors":[],"records_set_to_done":[]}
30802024-10-24T19:03:28.535ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
30812024-10-24T19:03:28.535ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
30822024-10-24T19:03:28.535ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 8.22\u{b5}s iteration = 18 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
30832024-10-24T19:03:28.535ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
30842024-10-24T19:03:28.535ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
30852024-10-24T19:03:28.535ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
30862024-10-24T19:03:28.535ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
30872024-10-24T19:03:28.535ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30882024-10-24T19:03:28.535ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
30892024-10-24T19:03:28.535ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 16.82\u{b5}s iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
30902024-10-24T19:03:28.535ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
30912024-10-24T19:03:28.535ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
30922024-10-24T19:03:28.535ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 7.431\u{b5}s iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
30932024-10-24T19:03:28.535ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
30942024-10-24T19:03:28.535ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30952024-10-24T19:03:28.535ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
30962024-10-24T19:03:28.535ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30972024-10-24T19:03:28.535ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30982024-10-24T19:03:28.535ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
30992024-10-24T19:03:28.535ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
31002024-10-24T19:03:28.535ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31012024-10-24T19:03:28.535ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
31022024-10-24T19:03:28.535ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
31032024-10-24T19:03:28.535ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31042024-10-24T19:03:28.535ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
31052024-10-24T19:03:28.535ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
31062024-10-24T19:03:28.536ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31072024-10-24T19:03:28.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
31082024-10-24T19:03:28.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
31092024-10-24T19:03:28.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31102024-10-24T19:03:28.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31112024-10-24T19:03:28.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
31122024-10-24T19:03:28.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31132024-10-24T19:03:28.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31142024-10-24T19:03:28.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31152024-10-24T19:03:28.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31162024-10-24T19:03:28.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31172024-10-24T19:03:28.537ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8ed5384f-0099-459e-a18a-fdd93abd3452.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8ed5384f-0099-459e-a18a-fdd93abd3452.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3451, tv_nsec: 900634007 } })
31182024-10-24T19:03:28.538ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8ed5384f-0099-459e-a18a-fdd93abd3452.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8ed5384f-0099-459e-a18a-fdd93abd3452.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3451, tv_nsec: 900926392 } })
31192024-10-24T19:03:28.538ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1105
31202024-10-24T19:03:28.538ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1105
31212024-10-24T19:03:28.538ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31222024-10-24T19:03:28.539ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31232024-10-24T19:03:28.540ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.360207ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
31242024-10-24T19:03:28.540ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31252024-10-24T19:03:28.541ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
31262024-10-24T19:03:28.541ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31272024-10-24T19:03:28.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31282024-10-24T19:03:28.542ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
31292024-10-24T19:03:28.542ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
31302024-10-24T19:03:28.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
31312024-10-24T19:03:28.543ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
31322024-10-24T19:03:28.543ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31332024-10-24T19:03:28.543ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31342024-10-24T19:03:28.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31352024-10-24T19:03:28.544ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31362024-10-24T19:03:28.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31372024-10-24T19:03:28.546ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
31382024-10-24T19:03:28.546ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31392024-10-24T19:03:28.546ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8ed5384f-0099-459e-a18a-fdd93abd3452.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8ed5384f-0099-459e-a18a-fdd93abd3452.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3451, tv_nsec: 909371842 } })
31402024-10-24T19:03:28.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31412024-10-24T19:03:28.546ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1105 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674
31422024-10-24T19:03:28.547ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
31432024-10-24T19:03:28.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31442024-10-24T19:03:28.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31452024-10-24T19:03:28.548ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
31462024-10-24T19:03:28.548ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31472024-10-24T19:03:28.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31482024-10-24T19:03:28.550ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31492024-10-24T19:03:28.550ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31502024-10-24T19:03:28.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31512024-10-24T19:03:28.551ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31522024-10-24T19:03:28.552ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31532024-10-24T19:03:28.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31542024-10-24T19:03:28.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31552024-10-24T19:03:28.552ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31562024-10-24T19:03:28.552ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
31572024-10-24T19:03:28.552ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31582024-10-24T19:03:28.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31592024-10-24T19:03:28.553ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31602024-10-24T19:03:28.554ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
31612024-10-24T19:03:28.554ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31622024-10-24T19:03:28.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31632024-10-24T19:03:28.555ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
31642024-10-24T19:03:28.555ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 19.698564ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
31652024-10-24T19:03:28.556ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: fbb59198-7d6e-40d8-9b05-3fd3707f9c53, lookup_type: ById(fbb59198-7d6e-40d8-9b05-3fd3707f9c53) } result = Ok(())
31662024-10-24T19:03:28.556ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31672024-10-24T19:03:28.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31682024-10-24T19:03:28.568ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31692024-10-24T19:03:28.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31702024-10-24T19:03:28.570ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
31712024-10-24T19:03:28.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
31722024-10-24T19:03:28.572ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = fbb59198-7d6e-40d8-9b05-3fd3707f9c53 original_time_created = 2024-10-24 18:54:46.689131 UTC target_id = fbb59198-7d6e-40d8-9b05-3fd3707f9c53 time_created = 2024-10-24 18:54:46.689131 UTC
31732024-10-24T19:03:28.572ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 36.400841ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"fbb59198-7d6e-40d8-9b05-3fd3707f9c53","time_created":"2024-10-24T18:54:46.689131Z"}
31742024-10-24T19:03:28.576ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31752024-10-24T19:03:28.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31762024-10-24T19:03:28.579ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
31772024-10-24T19:03:28.579ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
31782024-10-24T19:03:28.579ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31792024-10-24T19:03:28.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
31802024-10-24T19:03:28.580ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31812024-10-24T19:03:28.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31822024-10-24T19:03:28.583ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31832024-10-24T19:03:28.586ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8ed5384f-0099-459e-a18a-fdd93abd3452, lookup_type: ById(8ed5384f-0099-459e-a18a-fdd93abd3452) } result = Ok(())
31842024-10-24T19:03:28.586ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31852024-10-24T19:03:28.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31862024-10-24T19:03:28.589ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 53.956691ms iteration = 18 status = 0
31872024-10-24T19:03:28.601ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 65.817585ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
31882024-10-24T19:03:28.608ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1113 zone_address = fd00:1122:3344:101::2
31892024-10-24T19:03:28.608ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31902024-10-24T19:03:28.608ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "221924cf-3649-45d2-9127-b4f32631183e", "content-length": "26", "date": "Thu, 24 Oct 2024 19:03:28 GMT"} })
31912024-10-24T19:03:28.608ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1118 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31922024-10-24T19:03:28.609ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1150 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
31932024-10-24T19:03:28.611ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
31942024-10-24T19:03:28.611ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
31952024-10-24T19:03:28.611ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31962024-10-24T19:03:28.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
31972024-10-24T19:03:28.611ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1113 zone_address = fd00:1122:3344:101::2
31982024-10-24T19:03:28.611ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31992024-10-24T19:03:28.611ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3efc742b-d7e0-4043-bd76-bc1ba902e23d", "content-length": "26", "date": "Thu, 24 Oct 2024 19:03:28 GMT"} })
32002024-10-24T19:03:28.611ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1118 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
32012024-10-24T19:03:28.613ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1150 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
32022024-10-24T19:03:28.618ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 82.767195ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32032024-10-24T19:03:28.635ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1113 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 zone_address = fd00:1122:3344:101::2
32042024-10-24T19:03:28.635ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
32052024-10-24T19:03:28.635ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e8692c0-c7f8-456e-b19a-ae68ae29b51f", "content-length": "26", "date": "Thu, 24 Oct 2024 19:03:28 GMT"} })
32062024-10-24T19:03:28.635ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1118 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
32072024-10-24T19:03:28.637ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1150 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674
32082024-10-24T19:03:28.641ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32092024-10-24T19:03:28.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32102024-10-24T19:03:28.646ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
32112024-10-24T19:03:28.646ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
32122024-10-24T19:03:28.646ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 110.351511ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
32132024-10-24T19:03:28.665ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 129.642677ms iteration = 20 status = {"physical_disks_added":0}
32142024-10-24T19:03:28.714ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 180.141906ms iteration = 18 status = {}
32152024-10-24T19:03:28.726ZINFOnexus (BackgroundTasks): VPC route manager sled 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
32162024-10-24T19:03:28.726ZDEBGnexus (BackgroundTasks): client request SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
32172024-10-24T19:03:28.726ZDEBGnexus (BackgroundTasks): client response SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "06b5fbfd-e424-4b19-b731-4ee869d967de", "content-length": "372", "date": "Thu, 24 Oct 2024 19:03:28 GMT"} })
32182024-10-24T19:03:28.726ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32192024-10-24T19:03:28.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32202024-10-24T19:03:28.763ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
32212024-10-24T19:03:28.763ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "b96179ab-12d9-4a49-8a93-745554381171", "content-length": "2", "date": "Thu, 24 Oct 2024 19:03:28 GMT"} })
32222024-10-24T19:03:28.766ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
32232024-10-24T19:03:28.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
32242024-10-24T19:03:28.768ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 233.779723ms iteration = 18 status = null
32252024-10-24T19:03:28.781ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
32262024-10-24T19:03:28.781ZDEBGnexus (BackgroundTasks): client request SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
32272024-10-24T19:03:28.782ZDEBGnexus (BackgroundTasks): client response SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d992fe44-9d12-47dd-97e0-1682dd1f37b5", "date": "Thu, 24 Oct 2024 19:03:28 GMT"} })
32282024-10-24T19:03:28.782ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32292024-10-24T19:03:28.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32302024-10-24T19:03:28.784ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32312024-10-24T19:03:28.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32322024-10-24T19:03:28.787ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32332024-10-24T19:03:28.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32342024-10-24T19:03:28.791ZINFOnexus (BackgroundTasks): VPC route manager sled 8ed5384f-0099-459e-a18a-fdd93abd3452 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
32352024-10-24T19:03:28.791ZDEBGnexus (BackgroundTasks): client request SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
32362024-10-24T19:03:28.791ZDEBGnexus (BackgroundTasks): client response SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "bbad7146-196c-4567-9bf7-8d6473d004aa", "date": "Thu, 24 Oct 2024 19:03:28 GMT"} })
32372024-10-24T19:03:28.793ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 257.454268ms iteration = 19 status = {}
32382024-10-24T19:03:28.827ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32392024-10-24T19:03:28.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32402024-10-24T19:03:28.862ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32412024-10-24T19:03:28.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32422024-10-24T19:03:28.864ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32432024-10-24T19:03:28.866ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 95766534-d8e7-4baf-bb18-72c7cf344605, rack_id: d6d74c37-fa13-4dad-8a2e-066574b53674, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(d796208a-628d-40ec-83c5-b72b8cbc0e00) } rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 switch_location = Switch0
32442024-10-24T19:03:28.866ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32452024-10-24T19:03:28.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32462024-10-24T19:03:28.866ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
32472024-10-24T19:03:28.866ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32482024-10-24T19:03:28.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32492024-10-24T19:03:28.875ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
32502024-10-24T19:03:28.876ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee8df972-98c0-466c-a29f-b76859c8289b", "content-length": "121", "date": "Thu, 24 Oct 2024 19:03:28 GMT"} })
32512024-10-24T19:03:28.876ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
32522024-10-24T19:03:28.876ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = d796208a-628d-40ec-83c5-b72b8cbc0e00
32532024-10-24T19:03:28.876ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
32542024-10-24T19:03:28.876ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
32552024-10-24T19:03:28.876ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32562024-10-24T19:03:28.876ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32572024-10-24T19:03:28.876ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32582024-10-24T19:03:28.876ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
32592024-10-24T19:03:28.876ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32602024-10-24T19:03:28.876ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
32612024-10-24T19:03:28.876ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674
32622024-10-24T19:03:28.876ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32632024-10-24T19:03:28.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32642024-10-24T19:03:28.879ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
32652024-10-24T19:03:28.879ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "197515e2-91a3-48a8-80f0-ca4d01665c0c", "content-length": "2", "date": "Thu, 24 Oct 2024 19:03:28 GMT"} })
32662024-10-24T19:03:28.879ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
32672024-10-24T19:03:28.879ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "17fbc5ae-75f5-4f0f-a95a-d69c3268f952", "content-length": "52", "date": "Thu, 24 Oct 2024 19:03:28 GMT"} })
32682024-10-24T19:03:28.879ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 switch_location = Switch0
32692024-10-24T19:03:28.879ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
32702024-10-24T19:03:28.903ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32712024-10-24T19:03:28.905ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
32722024-10-24T19:03:28.905ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32732024-10-24T19:03:28.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32742024-10-24T19:03:28.991ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "0a5f055e-857c-4477-8484-b93416255f9a", "date": "Thu, 24 Oct 2024 19:03:28 GMT"} })
32752024-10-24T19:03:28.992ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 switch = Switch0
32762024-10-24T19:03:28.992ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
32772024-10-24T19:03:28.993ZDEBGnexus (BackgroundTasks): client request SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
32782024-10-24T19:03:29.085ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = d6d74c37-fa13-4dad-8a2e-066574b53674 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6a2bca9f-ef0a-4df0-9893-48d7f89a61cf", "content-length": "669", "date": "Thu, 24 Oct 2024 19:03:29 GMT"} })
32792024-10-24T19:03:29.085ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32802024-10-24T19:03:29.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32812024-10-24T19:03:29.085ZDEBGnexus (BackgroundTasks): client response SledAgent = 8ed5384f-0099-459e-a18a-fdd93abd3452 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "330f6d1f-479d-4114-b6b5-a948fa381c92", "content-length": "691", "date": "Thu, 24 Oct 2024 19:03:29 GMT"} })
32822024-10-24T19:03:29.085ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
32832024-10-24T19:03:29.085ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
32842024-10-24T19:03:29.085ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
32852024-10-24T19:03:29.087ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 551.593612ms iteration = 19 status = {}
32862024-10-24T19:03:29.089ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32872024-10-24T19:03:29.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32882024-10-24T19:03:29.092ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32892024-10-24T19:03:29.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32902024-10-24T19:03:29.094ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32912024-10-24T19:03:29.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32922024-10-24T19:03:29.101ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 565.851641ms iteration = 18 status = {}
32932024-10-24T19:03:29.266ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 87ed7602-88d2-42be-a74f-84ce05833e16 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
32942024-10-24T19:03:29.267ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 87ed7602-88d2-42be-a74f-84ce05833e16 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
32952024-10-24T19:03:29.268ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2182 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 87ed7602-88d2-42be-a74f-84ce05833e16 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
32962024-10-24T19:03:29.481ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 562 local_addr = [fd00:1122:3344:101::b]:60338 method = GET remote_addr = [fd00:1122:3344:101::d]:39079 req_id = a578d834-180a-4f51-980c-422f5b559251 response_code = 200 uri = /51c1446e-49e7-4598-8832-f33ccdf3c076
32972024-10-24T19:03:29.483ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
32982024-10-24T19:03:29.483ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
32992024-10-24T19:03:29.513ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
33002024-10-24T19:03:29.513ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:40996
33012024-10-24T19:03:29.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:40996 req_id = 3e7013bc-6756-408e-b313-d50223a9235b roles = RoleSet { roles: {} } uri = /metrics/producers
33022024-10-24T19:03:29.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:40996 req_id = 3e7013bc-6756-408e-b313-d50223a9235b resource = Database result = Ok(()) uri = /metrics/producers
33032024-10-24T19:03:29.578ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:337 id = d3774998-58a6-4b89-8d53-ad0f914d458d
33042024-10-24T19:03:29.578ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = d3774998-58a6-4b89-8d53-ad0f914d458d uri = http://[fd00:1122:3344:101::d]:12223/producers
33052024-10-24T19:03:29.579ZDEBGnexus: client response oximeter-collector = d3774998-58a6-4b89-8d53-ad0f914d458d result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "b56a0740-3f47-4248-99e5-b68fb2ddf021", "date": "Thu, 24 Oct 2024 19:03:29 GMT"} })
33062024-10-24T19:03:29.579ZINFOnexus: assigned collector to new producer collector_id = d3774998-58a6-4b89-8d53-ad0f914d458d file = nexus/src/app/oximeter.rs:144 producer_id = 51c1446e-49e7-4598-8832-f33ccdf3c076
33072024-10-24T19:03:29.580ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 66451 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:40996 req_id = 3e7013bc-6756-408e-b313-d50223a9235b response_code = 201 uri = /metrics/producers
33082024-10-24T19:03:29.580ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "3e7013bc-6756-408e-b313-d50223a9235b", "content-length": "41", "date": "Thu, 24 Oct 2024 19:03:29 GMT"} })
33092024-10-24T19:03:29.580ZDEBGnexus (producer-registration-task): registered with nexus successfully
33102024-10-24T19:03:29.580ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
33112024-10-24T19:03:30.290ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 6e9afcf4-9930-4d73-9230-8ce72370a7d7 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
33122024-10-24T19:03:30.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 6e9afcf4-9930-4d73-9230-8ce72370a7d7 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
33132024-10-24T19:03:30.293ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2813 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 6e9afcf4-9930-4d73-9230-8ce72370a7d7 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
33142024-10-24T19:03:31.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 7aa8df3e-7c9a-45d2-a344-579c89cd633d roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
33152024-10-24T19:03:31.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 7aa8df3e-7c9a-45d2-a344-579c89cd633d resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
33162024-10-24T19:03:31.314ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2542 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 7aa8df3e-7c9a-45d2-a344-579c89cd633d response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
33172024-10-24T19:03:32.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = a3807157-047b-4f38-9e58-04bf025662b0 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
33182024-10-24T19:03:32.336ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = a3807157-047b-4f38-9e58-04bf025662b0 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
33192024-10-24T19:03:32.338ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2569 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = a3807157-047b-4f38-9e58-04bf025662b0 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
33202024-10-24T19:03:33.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = f76bcdb6-c0e0-44d2-8168-5dfd94385f26 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
33212024-10-24T19:03:33.359ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = f76bcdb6-c0e0-44d2-8168-5dfd94385f26 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
33222024-10-24T19:03:33.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2104 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = f76bcdb6-c0e0-44d2-8168-5dfd94385f26 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
33232024-10-24T19:03:34.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 97eb0b39-63b1-4d0b-8a64-17bd7072cab1 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
33242024-10-24T19:03:34.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 97eb0b39-63b1-4d0b-8a64-17bd7072cab1 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
33252024-10-24T19:03:34.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2283 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 97eb0b39-63b1-4d0b-8a64-17bd7072cab1 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
33262024-10-24T19:03:35.404ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 4415f1e5-fcc5-4443-997a-c5375918472b roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
33272024-10-24T19:03:35.405ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 4415f1e5-fcc5-4443-997a-c5375918472b resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
33282024-10-24T19:03:35.407ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2679 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 4415f1e5-fcc5-4443-997a-c5375918472b response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
33292024-10-24T19:03:36.428ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 65261747-c5d0-49c9-b834-da9ab9840ca3 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
33302024-10-24T19:03:36.429ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 65261747-c5d0-49c9-b834-da9ab9840ca3 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
33312024-10-24T19:03:36.430ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2158 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 65261747-c5d0-49c9-b834-da9ab9840ca3 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
33322024-10-24T19:03:37.452ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = e49509ff-6f31-4f12-b895-7aab04f04fd4 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
33332024-10-24T19:03:37.452ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = e49509ff-6f31-4f12-b895-7aab04f04fd4 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
33342024-10-24T19:03:37.455ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3207 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = e49509ff-6f31-4f12-b895-7aab04f04fd4 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
33352024-10-24T19:03:38.475ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 714d667b-34ba-4e0d-a9c6-fd0bece9f58f roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
33362024-10-24T19:03:38.476ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 714d667b-34ba-4e0d-a9c6-fd0bece9f58f resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
33372024-10-24T19:03:38.477ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1938 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 714d667b-34ba-4e0d-a9c6-fd0bece9f58f response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
33382024-10-24T19:03:38.536ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
33392024-10-24T19:03:38.536ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
33402024-10-24T19:03:38.536ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33412024-10-24T19:03:38.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33422024-10-24T19:03:38.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33432024-10-24T19:03:38.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33442024-10-24T19:03:38.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33452024-10-24T19:03:38.565ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33462024-10-24T19:03:38.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33472024-10-24T19:03:38.566ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
33482024-10-24T19:03:38.566ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33492024-10-24T19:03:38.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33502024-10-24T19:03:38.567ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.461705ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
33512024-10-24T19:03:38.569ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33522024-10-24T19:03:38.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33532024-10-24T19:03:38.597ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33542024-10-24T19:03:38.599ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: fbb59198-7d6e-40d8-9b05-3fd3707f9c53, lookup_type: ById(fbb59198-7d6e-40d8-9b05-3fd3707f9c53) } result = Ok(())
33552024-10-24T19:03:38.599ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33562024-10-24T19:03:38.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33572024-10-24T19:03:38.609ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = fbb59198-7d6e-40d8-9b05-3fd3707f9c53 original_time_created = 2024-10-24 18:54:46.689131 UTC target_id = fbb59198-7d6e-40d8-9b05-3fd3707f9c53 time_created = 2024-10-24 18:54:46.689131 UTC
33582024-10-24T19:03:38.609ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 73.076397ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"fbb59198-7d6e-40d8-9b05-3fd3707f9c53","time_created":"2024-10-24T18:54:46.689131Z"}
33592024-10-24T19:03:39.497ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 851e565b-ffa9-42a6-b998-75b74ac1e877 roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
33602024-10-24T19:03:39.497ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 851e565b-ffa9-42a6-b998-75b74ac1e877 resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
33612024-10-24T19:03:39.499ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2196 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 851e565b-ffa9-42a6-b998-75b74ac1e877 response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
33622024-10-24T19:03:39.580ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 870 local_addr = [fd00:1122:3344:101::b]:60338 method = GET remote_addr = [fd00:1122:3344:101::d]:39079 req_id = 9fca258d-fff5-456f-ab58-ff85651a8a1b response_code = 200 uri = /51c1446e-49e7-4598-8832-f33ccdf3c076
33632024-10-24T19:03:40.518ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 2994cb37-196a-4f73-aa2c-5788c2e9fbdc roles = RoleSet { roles: {} } uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
33642024-10-24T19:03:40.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 2994cb37-196a-4f73-aa2c-5788c2e9fbdc resource = Database result = Ok(()) uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452
33652024-10-24T19:03:40.520ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2390 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:34923 req_id = 2994cb37-196a-4f73-aa2c-5788c2e9fbdc response_code = 200 uri = /probes/8ed5384f-0099-459e-a18a-fdd93abd3452