Max level shown:
12024-10-31T20:30:01.350ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = c5f10e2b-b5eb-4d35-840e-cec14fb84d83 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
22024-10-31T20:30:01.350ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = c5f10e2b-b5eb-4d35-840e-cec14fb84d83 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
32024-10-31T20:30:01.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3407 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = c5f10e2b-b5eb-4d35-840e-cec14fb84d83 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
42024-10-31T20:30:02.385ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = e47aa6ac-850a-4405-8278-625e66030218 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
52024-10-31T20:30:02.385ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = e47aa6ac-850a-4405-8278-625e66030218 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
62024-10-31T20:30:02.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2435 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = e47aa6ac-850a-4405-8278-625e66030218 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
72024-10-31T20:30:02.821ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1338 local_addr = [fd00:1122:3344:101::c]:63183 method = GET remote_addr = [fd00:1122:3344:101::d]:38560 req_id = 60c8badf-dcf6-4b0f-bc28-793f76f7bf63 response_code = 200 uri = /d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
82024-10-31T20:30:03.408ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = f8f8c729-5579-4f9f-9d5a-7197cbe9aec9 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
92024-10-31T20:30:03.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = f8f8c729-5579-4f9f-9d5a-7197cbe9aec9 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
102024-10-31T20:30:03.409ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1822 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = f8f8c729-5579-4f9f-9d5a-7197cbe9aec9 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
112024-10-31T20:30:04.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 6d574f5c-f3cc-4164-b3dd-cd45600176b2 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
122024-10-31T20:30:04.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 6d574f5c-f3cc-4164-b3dd-cd45600176b2 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
132024-10-31T20:30:04.435ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2350 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 6d574f5c-f3cc-4164-b3dd-cd45600176b2 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
142024-10-31T20:30:05.456ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 1969e9e7-902c-41a6-9fc2-9ecd3d8f3c70 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
152024-10-31T20:30:05.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 1969e9e7-902c-41a6-9fc2-9ecd3d8f3c70 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
162024-10-31T20:30:05.458ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2672 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 1969e9e7-902c-41a6-9fc2-9ecd3d8f3c70 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
172024-10-31T20:30:06.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 2bcdbd91-f9aa-4ad3-8a33-9249074028ed roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
182024-10-31T20:30:06.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 2bcdbd91-f9aa-4ad3-8a33-9249074028ed resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
192024-10-31T20:30:06.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2332 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 2bcdbd91-f9aa-4ad3-8a33-9249074028ed response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
202024-10-31T20:30:07.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = d3d83926-3026-476b-9874-0eb8d15a7043 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
212024-10-31T20:30:07.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = d3d83926-3026-476b-9874-0eb8d15a7043 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
222024-10-31T20:30:07.505ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2514 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = d3d83926-3026-476b-9874-0eb8d15a7043 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
232024-10-31T20:30:08.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = e5e0adca-2406-41af-b2d4-074b678c0ae2 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
242024-10-31T20:30:08.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = e5e0adca-2406-41af-b2d4-074b678c0ae2 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
252024-10-31T20:30:08.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1718 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = e5e0adca-2406-41af-b2d4-074b678c0ae2 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
262024-10-31T20:30:08.639ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
272024-10-31T20:30:08.639ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
282024-10-31T20:30:08.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
292024-10-31T20:30:08.640ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
302024-10-31T20:30:08.640ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
312024-10-31T20:30:08.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
322024-10-31T20:30:08.641ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
332024-10-31T20:30:08.641ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
342024-10-31T20:30:08.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
352024-10-31T20:30:08.644ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
362024-10-31T20:30:08.644ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
372024-10-31T20:30:08.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
382024-10-31T20:30:08.645ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
392024-10-31T20:30:08.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
402024-10-31T20:30:08.646ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
412024-10-31T20:30:08.649ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 56b527e7-66b3-4602-a305-5dc763e7fb8b, lookup_type: ById(56b527e7-66b3-4602-a305-5dc763e7fb8b) } result = Ok(())
422024-10-31T20:30:08.649ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
432024-10-31T20:30:08.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
442024-10-31T20:30:08.661ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b original_time_created = 2024-10-31 20:20:56.758465 UTC target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b time_created = 2024-10-31 20:20:56.758465 UTC
452024-10-31T20:30:08.661ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.855873ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"56b527e7-66b3-4602-a305-5dc763e7fb8b","time_created":"2024-10-31T20:20:56.758465Z"}
462024-10-31T20:30:08.669ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 28.975829ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
472024-10-31T20:30:09.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 25989653-ba62-4735-9474-8099bd5088da roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
482024-10-31T20:30:09.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 25989653-ba62-4735-9474-8099bd5088da resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
492024-10-31T20:30:09.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2318 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 25989653-ba62-4735-9474-8099bd5088da response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
502024-10-31T20:30:10.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = e8b671b3-7b74-42a3-b641-f133e7cbe943 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
512024-10-31T20:30:10.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = e8b671b3-7b74-42a3-b641-f133e7cbe943 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
522024-10-31T20:30:10.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2315 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = e8b671b3-7b74-42a3-b641-f133e7cbe943 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
532024-10-31T20:30:11.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = e2fdd5a0-596f-4795-b95b-6ffb4d85a3a1 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
542024-10-31T20:30:11.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = e2fdd5a0-596f-4795-b95b-6ffb4d85a3a1 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
552024-10-31T20:30:11.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1999 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = e2fdd5a0-596f-4795-b95b-6ffb4d85a3a1 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
562024-10-31T20:30:12.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 29dfb6d9-7c78-47ad-8ada-f17f9ee3b8b2 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
572024-10-31T20:30:12.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 29dfb6d9-7c78-47ad-8ada-f17f9ee3b8b2 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
582024-10-31T20:30:12.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2395 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 29dfb6d9-7c78-47ad-8ada-f17f9ee3b8b2 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
592024-10-31T20:30:13.643ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 31ac6edd-b5b6-4e2d-9d78-49835fab373c roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
602024-10-31T20:30:13.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 31ac6edd-b5b6-4e2d-9d78-49835fab373c resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
612024-10-31T20:30:13.646ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2207 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 31ac6edd-b5b6-4e2d-9d78-49835fab373c response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
622024-10-31T20:30:14.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 63308671-8ec3-4fa3-bfc9-aca465da8d32 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
632024-10-31T20:30:14.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 63308671-8ec3-4fa3-bfc9-aca465da8d32 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
642024-10-31T20:30:14.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2090 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 63308671-8ec3-4fa3-bfc9-aca465da8d32 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
652024-10-31T20:30:15.690ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 595a3873-36f9-4bc6-b2b7-6f283ba9c716 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
662024-10-31T20:30:15.691ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 595a3873-36f9-4bc6-b2b7-6f283ba9c716 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
672024-10-31T20:30:15.692ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2208 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 595a3873-36f9-4bc6-b2b7-6f283ba9c716 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
682024-10-31T20:30:16.713ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = a83cc9d8-5dde-43ec-a051-fce74d7fdc6a roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
692024-10-31T20:30:16.714ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = a83cc9d8-5dde-43ec-a051-fce74d7fdc6a resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
702024-10-31T20:30:16.715ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2069 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = a83cc9d8-5dde-43ec-a051-fce74d7fdc6a response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
712024-10-31T20:30:17.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 39da6ca0-166d-433e-b35f-14d0a753583e roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
722024-10-31T20:30:17.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 39da6ca0-166d-433e-b35f-14d0a753583e resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
732024-10-31T20:30:17.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1813 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 39da6ca0-166d-433e-b35f-14d0a753583e response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
742024-10-31T20:30:17.824ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1224 local_addr = [fd00:1122:3344:101::c]:63183 method = GET remote_addr = [fd00:1122:3344:101::d]:38560 req_id = 1dbda172-437d-4241-abdd-57bfec5ded66 response_code = 200 uri = /d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
752024-10-31T20:30:18.639ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
762024-10-31T20:30:18.639ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-10-31 20:20:18.639365343 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
772024-10-31T20:30:18.639ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
782024-10-31T20:30:18.639ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
792024-10-31T20:30:18.639ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
802024-10-31T20:30:18.639ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
812024-10-31T20:30:18.639ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
822024-10-31T20:30:18.639ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
832024-10-31T20:30:18.639ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
842024-10-31T20:30:18.639ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
852024-10-31T20:30:18.639ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
862024-10-31T20:30:18.639ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
872024-10-31T20:30:18.639ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
882024-10-31T20:30:18.639ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
892024-10-31T20:30:18.639ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
902024-10-31T20:30:18.639ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
912024-10-31T20:30:18.639ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
922024-10-31T20:30:18.639ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
932024-10-31T20:30:18.639ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
942024-10-31T20:30:18.639ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
952024-10-31T20:30:18.639ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
962024-10-31T20:30:18.639ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b
972024-10-31T20:30:18.639ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.49\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"56b527e7-66b3-4602-a305-5dc763e7fb8b"}
982024-10-31T20:30:18.639ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
992024-10-31T20:30:18.639ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
1002024-10-31T20:30:18.639ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1012024-10-31T20:30:18.639ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1022024-10-31T20:30:18.639ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
1032024-10-31T20:30:18.639ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1042024-10-31T20:30:18.639ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
1052024-10-31T20:30:18.639ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
1062024-10-31T20:30:18.639ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
1072024-10-31T20:30:18.639ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
1082024-10-31T20:30:18.639ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
1092024-10-31T20:30:18.639ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
1102024-10-31T20:30:18.639ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
1112024-10-31T20:30:18.639ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
1122024-10-31T20:30:18.639ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
1132024-10-31T20:30:18.639ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
1142024-10-31T20:30:18.639ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
1152024-10-31T20:30:18.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
1162024-10-31T20:30:18.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1172024-10-31T20:30:18.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1182024-10-31T20:30:18.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
1192024-10-31T20:30:18.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
1202024-10-31T20:30:18.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
1212024-10-31T20:30:18.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1222024-10-31T20:30:18.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1232024-10-31T20:30:18.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
1242024-10-31T20:30:18.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1252024-10-31T20:30:18.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1262024-10-31T20:30:18.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1272024-10-31T20:30:18.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1282024-10-31T20:30:18.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
1292024-10-31T20:30:18.640ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
1302024-10-31T20:30:18.640ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
1312024-10-31T20:30:18.640ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1322024-10-31T20:30:18.640ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
1332024-10-31T20:30:18.640ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
1342024-10-31T20:30:18.640ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 8.79\u{b5}s iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
1352024-10-31T20:30:18.640ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
1362024-10-31T20:30:18.640ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
1372024-10-31T20:30:18.640ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 4.57\u{b5}s iteration = 19 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
1382024-10-31T20:30:18.640ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
1392024-10-31T20:30:18.640ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
1402024-10-31T20:30:18.640ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 2.831\u{b5}s iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
1412024-10-31T20:30:18.640ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
1422024-10-31T20:30:18.640ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
1432024-10-31T20:30:18.640ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
1442024-10-31T20:30:18.640ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
1452024-10-31T20:30:18.640ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1462024-10-31T20:30:18.640ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1472024-10-31T20:30:18.640ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("02376501-3235-4cfe-a1cd-82b53358d277.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a8364658-9f18-48ec-a891-264e5c9fbbb6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("a8364658-9f18-48ec-a891-264e5c9fbbb6.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1531, tv_nsec: 298372456 } })
1482024-10-31T20:30:18.640ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
1492024-10-31T20:30:18.640ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 5.83\u{b5}s iteration = 19 status = {"errors":[],"records_set_to_done":[]}
1502024-10-31T20:30:18.640ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
1512024-10-31T20:30:18.640ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
1522024-10-31T20:30:18.640ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1532024-10-31T20:30:18.640ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
1542024-10-31T20:30:18.640ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
1552024-10-31T20:30:18.640ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8e750a05-d6dd-412d-aac1-b776b5e7757f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8e764cc9-00d9-46ed-80f0-316c9e4e0a2b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f87fba37-8eb7-413a-91fe-8caa94515963.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f87fba37-8eb7-413a-91fe-8caa94515963.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1531, tv_nsec: 298485278 } })
1562024-10-31T20:30:18.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
1572024-10-31T20:30:18.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1582024-10-31T20:30:18.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
1592024-10-31T20:30:18.640ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
1602024-10-31T20:30:18.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1612024-10-31T20:30:18.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1622024-10-31T20:30:18.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
1632024-10-31T20:30:18.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
1642024-10-31T20:30:18.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1652024-10-31T20:30:18.640ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
1662024-10-31T20:30:18.640ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.012437ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
1672024-10-31T20:30:18.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
1682024-10-31T20:30:18.640ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
1692024-10-31T20:30:18.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
1702024-10-31T20:30:18.640ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
1712024-10-31T20:30:18.640ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
1722024-10-31T20:30:18.640ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.325813ms iteration = 11 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
1732024-10-31T20:30:18.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
1742024-10-31T20:30:18.641ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1752024-10-31T20:30:18.642ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-10-31 20:20:18.639365343 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
1762024-10-31T20:30:18.642ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 2.85996ms iteration = 10 status = {"expiration":"2024-10-31T20:20:18.639365343Z","pruned":[]}
1772024-10-31T20:30:18.643ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.294985ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
1782024-10-31T20:30:18.643ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
1792024-10-31T20:30:18.643ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
1802024-10-31T20:30:18.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1812024-10-31T20:30:18.645ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1822024-10-31T20:30:18.645ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1832024-10-31T20:30:18.646ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1842024-10-31T20:30:18.646ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1531, tv_nsec: 304576605 } })
1852024-10-31T20:30:18.646ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
1862024-10-31T20:30:18.646ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1531, tv_nsec: 305018893 } })
1872024-10-31T20:30:18.647ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
1882024-10-31T20:30:18.648ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
1892024-10-31T20:30:18.648ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1902024-10-31T20:30:18.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1912024-10-31T20:30:18.648ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
1922024-10-31T20:30:18.648ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
1932024-10-31T20:30:18.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
1942024-10-31T20:30:18.648ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1952024-10-31T20:30:18.648ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1962024-10-31T20:30:18.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1972024-10-31T20:30:18.649ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
1982024-10-31T20:30:18.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
1992024-10-31T20:30:18.649ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2002024-10-31T20:30:18.650ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2012024-10-31T20:30:18.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2022024-10-31T20:30:18.650ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2032024-10-31T20:30:18.651ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2042024-10-31T20:30:18.653ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 12.853636ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
2052024-10-31T20:30:18.653ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
2062024-10-31T20:30:18.653ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2072024-10-31T20:30:18.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2082024-10-31T20:30:18.653ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
2092024-10-31T20:30:18.653ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2102024-10-31T20:30:18.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2112024-10-31T20:30:18.654ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
2122024-10-31T20:30:18.654ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
2132024-10-31T20:30:18.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2142024-10-31T20:30:18.656ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2152024-10-31T20:30:18.658ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2162024-10-31T20:30:18.658ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
2172024-10-31T20:30:18.658ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
2182024-10-31T20:30:18.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
2192024-10-31T20:30:18.660ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2202024-10-31T20:30:18.660ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2212024-10-31T20:30:18.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2222024-10-31T20:30:18.667ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2232024-10-31T20:30:18.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2242024-10-31T20:30:18.668ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1531, tv_nsec: 326297016 } })
2252024-10-31T20:30:18.668ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2262024-10-31T20:30:18.668ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2272024-10-31T20:30:18.668ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439
2282024-10-31T20:30:18.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2292024-10-31T20:30:18.670ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2302024-10-31T20:30:18.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2312024-10-31T20:30:18.672ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
2322024-10-31T20:30:18.675ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2332024-10-31T20:30:18.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2342024-10-31T20:30:18.676ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2352024-10-31T20:30:18.679ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2362024-10-31T20:30:18.679ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2372024-10-31T20:30:18.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2382024-10-31T20:30:18.683ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
2392024-10-31T20:30:18.683ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 43.368821ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
2402024-10-31T20:30:18.694ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2412024-10-31T20:30:18.698ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 56b527e7-66b3-4602-a305-5dc763e7fb8b, lookup_type: ById(56b527e7-66b3-4602-a305-5dc763e7fb8b) } result = Ok(())
2422024-10-31T20:30:18.698ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2432024-10-31T20:30:18.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2442024-10-31T20:30:18.702ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
2452024-10-31T20:30:18.702ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2462024-10-31T20:30:18.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
2472024-10-31T20:30:18.704ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
2482024-10-31T20:30:18.704ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
2492024-10-31T20:30:18.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2502024-10-31T20:30:18.706ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
2512024-10-31T20:30:18.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
2522024-10-31T20:30:18.709ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2532024-10-31T20:30:18.710ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2542024-10-31T20:30:18.710ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
2552024-10-31T20:30:18.710ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2562024-10-31T20:30:18.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2572024-10-31T20:30:18.711ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
2582024-10-31T20:30:18.711ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
2592024-10-31T20:30:18.711ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 70.973356ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
2602024-10-31T20:30:18.712ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
2612024-10-31T20:30:18.712ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
2622024-10-31T20:30:18.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2632024-10-31T20:30:18.712ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2642024-10-31T20:30:18.714ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2652024-10-31T20:30:18.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2662024-10-31T20:30:18.714ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
2672024-10-31T20:30:18.714ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
2682024-10-31T20:30:18.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2692024-10-31T20:30:18.715ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2702024-10-31T20:30:18.715ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
2712024-10-31T20:30:18.715ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
2722024-10-31T20:30:18.715ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
2732024-10-31T20:30:18.715ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2742024-10-31T20:30:18.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2752024-10-31T20:30:18.716ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 76.295268ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
2762024-10-31T20:30:18.716ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2772024-10-31T20:30:18.716ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
2782024-10-31T20:30:18.716ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
2792024-10-31T20:30:18.716ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 77.319687ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
2802024-10-31T20:30:18.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2812024-10-31T20:30:18.717ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b original_time_created = 2024-10-31 20:20:56.758465 UTC target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b time_created = 2024-10-31 20:20:56.758465 UTC
2822024-10-31T20:30:18.717ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 77.698843ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"56b527e7-66b3-4602-a305-5dc763e7fb8b","time_created":"2024-10-31T20:20:56.758465Z"}
2832024-10-31T20:30:18.717ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
2842024-10-31T20:30:18.717ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
2852024-10-31T20:30:18.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2862024-10-31T20:30:18.718ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2872024-10-31T20:30:18.719ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2882024-10-31T20:30:18.720ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2892024-10-31T20:30:18.720ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2902024-10-31T20:30:18.720ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 81.361488ms iteration = 5 status = {"nsuccess":5}
2912024-10-31T20:30:18.721ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2922024-10-31T20:30:18.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2932024-10-31T20:30:18.722ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
2942024-10-31T20:30:18.723ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2952024-10-31T20:30:18.723ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2962024-10-31T20:30:18.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2972024-10-31T20:30:18.724ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
2982024-10-31T20:30:18.724ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2992024-10-31T20:30:18.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3002024-10-31T20:30:18.725ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
3012024-10-31T20:30:18.725ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3022024-10-31T20:30:18.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3032024-10-31T20:30:18.726ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3042024-10-31T20:30:18.731ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 622abb78-eb68-41c1-ac52-e7a263024e57, lookup_type: ById(622abb78-eb68-41c1-ac52-e7a263024e57) } result = Ok(())
3052024-10-31T20:30:18.731ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3062024-10-31T20:30:18.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3072024-10-31T20:30:18.734ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 95.447385ms iteration = 22 status = {"physical_disks_added":0}
3082024-10-31T20:30:18.742ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 103.14252ms iteration = 19 status = 0
3092024-10-31T20:30:18.751ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 112.383132ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
3102024-10-31T20:30:18.754ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
3112024-10-31T20:30:18.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
3122024-10-31T20:30:18.757ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
3132024-10-31T20:30:18.757ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
3142024-10-31T20:30:18.757ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
3152024-10-31T20:30:18.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
3162024-10-31T20:30:18.759ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
3172024-10-31T20:30:18.759ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
3182024-10-31T20:30:18.759ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
3192024-10-31T20:30:18.759ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3202024-10-31T20:30:18.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3212024-10-31T20:30:18.760ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 182c09c4-a72e-444c-93ff-ab676ea975ec roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
3222024-10-31T20:30:18.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 182c09c4-a72e-444c-93ff-ab676ea975ec resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
3232024-10-31T20:30:18.761ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3242024-10-31T20:30:18.762ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2237 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 182c09c4-a72e-444c-93ff-ab676ea975ec response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
3252024-10-31T20:30:18.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
3262024-10-31T20:30:18.764ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3272024-10-31T20:30:18.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3282024-10-31T20:30:18.767ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
3292024-10-31T20:30:18.767ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 1a5173f7-64b4-48db-9160-caa5913594e3 dns_zone_name = oxide.test found_so_far = 0 version = 2
3302024-10-31T20:30:18.767ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3312024-10-31T20:30:18.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3322024-10-31T20:30:18.769ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3332024-10-31T20:30:18.770ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3342024-10-31T20:30:18.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3352024-10-31T20:30:18.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
3362024-10-31T20:30:18.772ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3372024-10-31T20:30:18.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3382024-10-31T20:30:18.772ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3392024-10-31T20:30:18.772ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
3402024-10-31T20:30:18.773ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
3412024-10-31T20:30:18.773ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3422024-10-31T20:30:18.773ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b0aaf470-2bea-4e19-a7dc-bc6f2beeb52c", "content-length": "26", "date": "Thu, 31 Oct 2024 20:30:17 GMT"} })
3432024-10-31T20:30:18.773ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
3442024-10-31T20:30:18.774ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
3452024-10-31T20:30:18.774ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3462024-10-31T20:30:18.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3472024-10-31T20:30:18.774ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 1a5173f7-64b4-48db-9160-caa5913594e3 dns_zone_name = oxide.test found_so_far = 1 version = 2
3482024-10-31T20:30:18.774ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
3492024-10-31T20:30:18.774ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-10-31 20:21:23.098854 UTC dns_group = external generation = 2
3502024-10-31T20:30:18.774ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 134.943507ms iteration = 11 status = {"generation":2}
3512024-10-31T20:30:18.775ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
3522024-10-31T20:30:18.793ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
3532024-10-31T20:30:18.793ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 9bbba0df-c792-4ba2-925b-ab02ed6483a1 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
3542024-10-31T20:30:18.793ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3552024-10-31T20:30:18.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3562024-10-31T20:30:18.796ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
3572024-10-31T20:30:18.796ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
3582024-10-31T20:30:18.796ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 156.074288ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
3592024-10-31T20:30:18.798ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
3602024-10-31T20:30:18.798ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 157.86012ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
3612024-10-31T20:30:18.807ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-10-31T20:21:09.823788Z, time_modified: 2024-10-31T20:21:09.823788Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9efc5118-5ea4-4fe1-a8c5-501dee3e98c0, db_silo: Silo { identity: SiloIdentity { id: 9efc5118-5ea4-4fe1-a8c5-501dee3e98c0, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-31T20:21:23.039241Z, time_modified: 2024-10-31T20:21:23.039241Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "fffc2e5c59e415981668ee3af9418c2de014d1976b7a03713830fdf9f35a71e6" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9efc5118-5ea4-4fe1-a8c5-501dee3e98c0, db_silo: Silo { identity: SiloIdentity { id: 9efc5118-5ea4-4fe1-a8c5-501dee3e98c0, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-31T20:21:23.039241Z, time_modified: 2024-10-31T20:21:23.039241Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "fffc2e5c59e415981668ee3af9418c2de014d1976b7a03713830fdf9f35a71e6" }] }) }
3622024-10-31T20:30:18.807ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 167.641952ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9efc5118-5ea4-4fe1-a8c5-501dee3e98c0","tls_certs":["fffc2e5c59e415981668ee3af9418c2de014d1976b7a03713830fdf9f35a71e6"]}},"default_endpoint":{"silo_id":"9efc5118-5ea4-4fe1-a8c5-501dee3e98c0","tls_certs":["fffc2e5c59e415981668ee3af9418c2de014d1976b7a03713830fdf9f35a71e6"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
3632024-10-31T20:30:18.820ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3642024-10-31T20:30:18.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
3652024-10-31T20:30:18.823ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3662024-10-31T20:30:18.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3672024-10-31T20:30:18.823ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 zone_address = fd00:1122:3344:101::2
3682024-10-31T20:30:18.823ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3692024-10-31T20:30:18.824ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3cc5805b-542e-4900-8d0c-7b3970ff96ef", "content-length": "26", "date": "Thu, 31 Oct 2024 20:30:18 GMT"} })
3702024-10-31T20:30:18.824ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
3712024-10-31T20:30:18.825ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439
3722024-10-31T20:30:18.827ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3732024-10-31T20:30:18.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3742024-10-31T20:30:18.887ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
3752024-10-31T20:30:18.949ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
3762024-10-31T20:30:18.950ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 310.566869ms iteration = 19 status = {}
3772024-10-31T20:30:18.950ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "ec64e29f-5c7c-4a8c-a523-5640a056e40a", "date": "Thu, 31 Oct 2024 20:30:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
3782024-10-31T20:30:18.950ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
3792024-10-31T20:30:18.953ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "ee9e48fb-9f5e-4698-83f6-16c1117b76bf", "date": "Thu, 31 Oct 2024 20:30:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
3802024-10-31T20:30:18.953ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
3812024-10-31T20:30:18.953ZINFOnexus (BackgroundTasks): VPC route manager sled 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
3822024-10-31T20:30:18.953ZDEBGnexus (BackgroundTasks): client request SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
3832024-10-31T20:30:18.954ZDEBGnexus (BackgroundTasks): client response SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b189e24c-04c8-4b53-a369-62140d44d2d4", "content-length": "372", "date": "Thu, 31 Oct 2024 20:30:18 GMT"} })
3842024-10-31T20:30:18.954ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3852024-10-31T20:30:18.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3862024-10-31T20:30:18.954ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
3872024-10-31T20:30:18.954ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 315.267152ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
3882024-10-31T20:30:18.956ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3892024-10-31T20:30:18.956ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 9bbba0df-c792-4ba2-925b-ab02ed6483a1 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
3902024-10-31T20:30:18.956ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
3912024-10-31T20:30:18.956ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-10-31 20:21:21.652645 UTC dns_group = internal generation = 1
3922024-10-31T20:30:18.956ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 316.865371ms iteration = 11 status = {"generation":1}
3932024-10-31T20:30:18.957ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
3942024-10-31T20:30:18.957ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3952024-10-31T20:30:18.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3962024-10-31T20:30:18.960ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
3972024-10-31T20:30:18.960ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3982024-10-31T20:30:18.960ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9369c483-6621-4cc1-b7d1-969b52e14d0d", "content-length": "26", "date": "Thu, 31 Oct 2024 20:30:18 GMT"} })
3992024-10-31T20:30:18.960ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4002024-10-31T20:30:18.961ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
4012024-10-31T20:30:18.985ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4022024-10-31T20:30:18.988ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
4032024-10-31T20:30:18.988ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4042024-10-31T20:30:18.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4052024-10-31T20:30:18.997ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
4062024-10-31T20:30:18.997ZDEBGnexus (BackgroundTasks): client request SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
4072024-10-31T20:30:18.997ZDEBGnexus (BackgroundTasks): client response SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "892eda7a-1f18-4d77-84d5-93928d79c26f", "date": "Thu, 31 Oct 2024 20:30:18 GMT"} })
4082024-10-31T20:30:18.997ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4092024-10-31T20:30:18.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4102024-10-31T20:30:18.999ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4112024-10-31T20:30:18.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4122024-10-31T20:30:19.003ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4132024-10-31T20:30:19.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4142024-10-31T20:30:19.006ZINFOnexus (BackgroundTasks): VPC route manager sled 622abb78-eb68-41c1-ac52-e7a263024e57 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
4152024-10-31T20:30:19.006ZDEBGnexus (BackgroundTasks): client request SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
4162024-10-31T20:30:19.007ZDEBGnexus (BackgroundTasks): client response SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "56459fe8-8162-46b8-a017-8bfd56e1ab0b", "date": "Thu, 31 Oct 2024 20:30:18 GMT"} })
4172024-10-31T20:30:19.009ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 369.334191ms iteration = 20 status = {}
4182024-10-31T20:30:19.016ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
4192024-10-31T20:30:19.038ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
4202024-10-31T20:30:19.039ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "ed20134f-5220-40a9-aa65-95802fd9a9c3", "content-length": "1", "date": "Thu, 31 Oct 2024 20:30:18 GMT"} })
4212024-10-31T20:30:19.042ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4222024-10-31T20:30:19.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4232024-10-31T20:30:19.044ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 405.293652ms iteration = 19 status = null
4242024-10-31T20:30:19.107ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
4252024-10-31T20:30:19.108ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "35566fdc-3cae-4aa1-a83e-c1e3af0ee795", "date": "Thu, 31 Oct 2024 20:30:19 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
4262024-10-31T20:30:19.108ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
4272024-10-31T20:30:19.110ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "e5970cdb-b44a-4c51-a58d-43c3557779b3", "date": "Thu, 31 Oct 2024 20:30:19 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
4282024-10-31T20:30:19.110ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
4292024-10-31T20:30:19.113ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "a2abfd8b-2646-448b-8a55-c74765a6d7a3", "date": "Thu, 31 Oct 2024 20:30:19 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
4302024-10-31T20:30:19.113ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
4312024-10-31T20:30:19.115ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
4322024-10-31T20:30:19.115ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 476.295428ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
4332024-10-31T20:30:19.145ZDEBGnexus (BackgroundTasks): client request SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
4342024-10-31T20:30:19.145ZDEBGnexus (BackgroundTasks): client response SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "60859770-4631-4f0c-ad34-2bc247b777bf", "content-length": "691", "date": "Thu, 31 Oct 2024 20:30:18 GMT"} })
4352024-10-31T20:30:19.146ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
4362024-10-31T20:30:19.146ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
4372024-10-31T20:30:19.146ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
4382024-10-31T20:30:19.147ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 508.094416ms iteration = 19 status = {}
4392024-10-31T20:30:19.160ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4402024-10-31T20:30:19.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4412024-10-31T20:30:19.167ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2c0ce4ae-e332-4e80-bd64-c2d6cfd99f8f, rack_id: cf9a2d24-88ed-47a2-a402-0cbbba2d1439, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(1479dccf-28ea-4cc0-9964-818390bddf17) } rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 switch_location = Switch0
4422024-10-31T20:30:19.167ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4432024-10-31T20:30:19.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4442024-10-31T20:30:19.178ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
4452024-10-31T20:30:19.178ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "beaff59d-e753-4dde-97e6-66fb0a903c0b", "content-length": "121", "date": "Thu, 31 Oct 2024 20:30:19 GMT"} })
4462024-10-31T20:30:19.178ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
4472024-10-31T20:30:19.178ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 1479dccf-28ea-4cc0-9964-818390bddf17
4482024-10-31T20:30:19.178ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
4492024-10-31T20:30:19.178ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
4502024-10-31T20:30:19.178ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4512024-10-31T20:30:19.178ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4522024-10-31T20:30:19.178ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4532024-10-31T20:30:19.178ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
4542024-10-31T20:30:19.179ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4552024-10-31T20:30:19.179ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
4562024-10-31T20:30:19.179ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439
4572024-10-31T20:30:19.179ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4582024-10-31T20:30:19.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4592024-10-31T20:30:19.181ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
4602024-10-31T20:30:19.181ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e9d1cd78-90ba-4c9a-9dfc-a8e0a2e3b974", "content-length": "2", "date": "Thu, 31 Oct 2024 20:30:19 GMT"} })
4612024-10-31T20:30:19.181ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
4622024-10-31T20:30:19.181ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "1cd0cb0d-3af6-4b6f-a879-24f0d0c1e273", "content-length": "52", "date": "Thu, 31 Oct 2024 20:30:19 GMT"} })
4632024-10-31T20:30:19.181ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 switch_location = Switch0
4642024-10-31T20:30:19.181ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
4652024-10-31T20:30:19.298ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "639503ab-01cb-4021-8f41-261974c3cc63", "date": "Thu, 31 Oct 2024 20:30:18 GMT"} })
4662024-10-31T20:30:19.298ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 switch = Switch0
4672024-10-31T20:30:19.298ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
4682024-10-31T20:30:19.298ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e437ef62-13bc-4e72-9c7c-02aa90d01009", "content-length": "669", "date": "Thu, 31 Oct 2024 20:30:18 GMT"} })
4692024-10-31T20:30:19.298ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4702024-10-31T20:30:19.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4712024-10-31T20:30:19.302ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4722024-10-31T20:30:19.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4732024-10-31T20:30:19.305ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4742024-10-31T20:30:19.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4752024-10-31T20:30:19.308ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4762024-10-31T20:30:19.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4772024-10-31T20:30:19.315ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 676.324557ms iteration = 19 status = {}
4782024-10-31T20:30:19.785ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 5763ec4d-dad7-4bcc-91df-500b5339f8a1 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
4792024-10-31T20:30:19.785ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 5763ec4d-dad7-4bcc-91df-500b5339f8a1 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
4802024-10-31T20:30:19.787ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2426 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 5763ec4d-dad7-4bcc-91df-500b5339f8a1 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
4812024-10-31T20:30:19.996ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46541 req_id = 12c7aa13-d42c-4df0-b7c2-f103c4278fab roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
4822024-10-31T20:30:19.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46541 req_id = 12c7aa13-d42c-4df0-b7c2-f103c4278fab resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
4832024-10-31T20:30:20.000ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3354 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46541 req_id = 12c7aa13-d42c-4df0-b7c2-f103c4278fab response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
4842024-10-31T20:30:20.806ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 4ee75f37-9f2d-48bb-9f6e-26979118790a roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
4852024-10-31T20:30:20.806ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 4ee75f37-9f2d-48bb-9f6e-26979118790a resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
4862024-10-31T20:30:20.808ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2269 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 4ee75f37-9f2d-48bb-9f6e-26979118790a response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
4872024-10-31T20:30:21.829ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = fdc78240-d6d4-4c65-8cf3-95aee7d45fe6 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
4882024-10-31T20:30:21.829ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = fdc78240-d6d4-4c65-8cf3-95aee7d45fe6 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
4892024-10-31T20:30:21.831ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1923 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = fdc78240-d6d4-4c65-8cf3-95aee7d45fe6 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
4902024-10-31T20:30:22.852ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 2ea1437e-8bd2-445e-90d3-fa336780955c roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
4912024-10-31T20:30:22.852ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 2ea1437e-8bd2-445e-90d3-fa336780955c resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
4922024-10-31T20:30:22.854ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2247 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 2ea1437e-8bd2-445e-90d3-fa336780955c response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
4932024-10-31T20:30:23.876ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = c3796e6e-e55b-4fe9-8119-517840515a0e roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
4942024-10-31T20:30:23.877ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = c3796e6e-e55b-4fe9-8119-517840515a0e resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
4952024-10-31T20:30:23.878ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1956 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = c3796e6e-e55b-4fe9-8119-517840515a0e response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
4962024-10-31T20:30:24.899ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 3b65ed3f-a860-44ad-8844-7c8536f48d2d roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
4972024-10-31T20:30:24.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 3b65ed3f-a860-44ad-8844-7c8536f48d2d resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
4982024-10-31T20:30:24.901ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2559 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 3b65ed3f-a860-44ad-8844-7c8536f48d2d response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
4992024-10-31T20:30:25.923ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 70d08d4f-2316-4937-9941-d7c4be8d1b90 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
5002024-10-31T20:30:25.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 70d08d4f-2316-4937-9941-d7c4be8d1b90 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
5012024-10-31T20:30:25.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2449 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 70d08d4f-2316-4937-9941-d7c4be8d1b90 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
5022024-10-31T20:30:26.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 4d28822b-d5e6-47b2-bf15-92c49b11c856 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
5032024-10-31T20:30:26.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 4d28822b-d5e6-47b2-bf15-92c49b11c856 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
5042024-10-31T20:30:26.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1971 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 4d28822b-d5e6-47b2-bf15-92c49b11c856 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
5052024-10-31T20:30:27.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 0a41a302-c7d0-4d7d-a9dd-a6491c5b5b8e roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
5062024-10-31T20:30:27.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 0a41a302-c7d0-4d7d-a9dd-a6491c5b5b8e resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
5072024-10-31T20:30:27.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2232 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 0a41a302-c7d0-4d7d-a9dd-a6491c5b5b8e response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
5082024-10-31T20:30:28.639ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
5092024-10-31T20:30:28.639ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5102024-10-31T20:30:28.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5112024-10-31T20:30:28.640ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
5122024-10-31T20:30:28.640ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5132024-10-31T20:30:28.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5142024-10-31T20:30:28.641ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5152024-10-31T20:30:28.643ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5162024-10-31T20:30:28.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5172024-10-31T20:30:28.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5182024-10-31T20:30:28.646ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5192024-10-31T20:30:28.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5202024-10-31T20:30:28.649ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5212024-10-31T20:30:28.652ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 56b527e7-66b3-4602-a305-5dc763e7fb8b, lookup_type: ById(56b527e7-66b3-4602-a305-5dc763e7fb8b) } result = Ok(())
5222024-10-31T20:30:28.652ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5232024-10-31T20:30:28.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5242024-10-31T20:30:28.664ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b original_time_created = 2024-10-31 20:20:56.758465 UTC target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b time_created = 2024-10-31 20:20:56.758465 UTC
5252024-10-31T20:30:28.664ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.372215ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"56b527e7-66b3-4602-a305-5dc763e7fb8b","time_created":"2024-10-31T20:20:56.758465Z"}
5262024-10-31T20:30:28.674ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5272024-10-31T20:30:28.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5282024-10-31T20:30:28.676ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.102004ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
5292024-10-31T20:30:28.992ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 915ce8e9-0772-4085-a4ae-0a9a3e84097b roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
5302024-10-31T20:30:28.993ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 915ce8e9-0772-4085-a4ae-0a9a3e84097b resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
5312024-10-31T20:30:28.994ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2176 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 915ce8e9-0772-4085-a4ae-0a9a3e84097b response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
5322024-10-31T20:30:30.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 0d25d861-33de-453b-8760-49f1b132def7 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
5332024-10-31T20:30:30.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 0d25d861-33de-453b-8760-49f1b132def7 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
5342024-10-31T20:30:30.018ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2329 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 0d25d861-33de-453b-8760-49f1b132def7 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
5352024-10-31T20:30:31.038ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 37e3d3cb-b7ce-494e-a2d3-a079a53da468 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
5362024-10-31T20:30:31.039ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 37e3d3cb-b7ce-494e-a2d3-a079a53da468 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
5372024-10-31T20:30:31.040ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1775 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 37e3d3cb-b7ce-494e-a2d3-a079a53da468 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
5382024-10-31T20:30:32.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 6adb86f8-35a3-4863-aae4-e7e7e3d02d52 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
5392024-10-31T20:30:32.062ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 6adb86f8-35a3-4863-aae4-e7e7e3d02d52 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
5402024-10-31T20:30:32.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2465 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 6adb86f8-35a3-4863-aae4-e7e7e3d02d52 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
5412024-10-31T20:30:32.825ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2422 local_addr = [fd00:1122:3344:101::c]:63183 method = GET remote_addr = [fd00:1122:3344:101::d]:38560 req_id = c879d8e6-6b44-482d-b56c-5ac261f19dae response_code = 200 uri = /d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
5422024-10-31T20:30:33.085ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 14628970-b60a-4fd3-8f30-7631231c09db roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
5432024-10-31T20:30:33.086ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 14628970-b60a-4fd3-8f30-7631231c09db resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
5442024-10-31T20:30:33.088ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2251 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 14628970-b60a-4fd3-8f30-7631231c09db response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
5452024-10-31T20:30:34.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 0d83e303-9cf3-4ea0-b318-dcb9b26dabe1 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
5462024-10-31T20:30:34.110ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 0d83e303-9cf3-4ea0-b318-dcb9b26dabe1 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
5472024-10-31T20:30:34.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2204 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 0d83e303-9cf3-4ea0-b318-dcb9b26dabe1 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
5482024-10-31T20:30:35.132ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 0f2c050f-79d1-4cb0-81dd-f18a90c099f6 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
5492024-10-31T20:30:35.133ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 0f2c050f-79d1-4cb0-81dd-f18a90c099f6 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
5502024-10-31T20:30:35.134ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1805 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 0f2c050f-79d1-4cb0-81dd-f18a90c099f6 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
5512024-10-31T20:30:36.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 59663756-2830-4d37-a4e7-d1346f49517d roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
5522024-10-31T20:30:36.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 59663756-2830-4d37-a4e7-d1346f49517d resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
5532024-10-31T20:30:36.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1665 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 59663756-2830-4d37-a4e7-d1346f49517d response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
5542024-10-31T20:30:37.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 938574bb-3310-4db6-bf75-218e575c2703 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
5552024-10-31T20:30:37.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 938574bb-3310-4db6-bf75-218e575c2703 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
5562024-10-31T20:30:37.181ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2160 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 938574bb-3310-4db6-bf75-218e575c2703 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
5572024-10-31T20:30:38.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 57c82f9d-29dc-4326-9efe-300d7529c32b roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
5582024-10-31T20:30:38.203ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 57c82f9d-29dc-4326-9efe-300d7529c32b resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
5592024-10-31T20:30:38.205ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2286 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 57c82f9d-29dc-4326-9efe-300d7529c32b response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
5602024-10-31T20:30:38.640ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
5612024-10-31T20:30:38.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5622024-10-31T20:30:38.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5632024-10-31T20:30:38.640ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
5642024-10-31T20:30:38.640ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5652024-10-31T20:30:38.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5662024-10-31T20:30:38.642ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5672024-10-31T20:30:38.642ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5682024-10-31T20:30:38.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5692024-10-31T20:30:38.644ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5702024-10-31T20:30:38.644ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5712024-10-31T20:30:38.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5722024-10-31T20:30:38.647ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5732024-10-31T20:30:38.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5742024-10-31T20:30:38.651ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5752024-10-31T20:30:38.653ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 56b527e7-66b3-4602-a305-5dc763e7fb8b, lookup_type: ById(56b527e7-66b3-4602-a305-5dc763e7fb8b) } result = Ok(())
5762024-10-31T20:30:38.653ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5772024-10-31T20:30:38.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5782024-10-31T20:30:38.666ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b original_time_created = 2024-10-31 20:20:56.758465 UTC target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b time_created = 2024-10-31 20:20:56.758465 UTC
5792024-10-31T20:30:38.666ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.161969ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"56b527e7-66b3-4602-a305-5dc763e7fb8b","time_created":"2024-10-31T20:20:56.758465Z"}
5802024-10-31T20:30:38.676ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.165995ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
5812024-10-31T20:30:39.226ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 90452124-ac07-4da1-a47e-0d5f61343aea roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
5822024-10-31T20:30:39.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 90452124-ac07-4da1-a47e-0d5f61343aea resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
5832024-10-31T20:30:39.228ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1901 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 90452124-ac07-4da1-a47e-0d5f61343aea response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
5842024-10-31T20:30:40.249ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 99978a21-212e-4742-b7a1-19f6a464f719 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
5852024-10-31T20:30:40.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 99978a21-212e-4742-b7a1-19f6a464f719 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
5862024-10-31T20:30:40.251ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1921 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 99978a21-212e-4742-b7a1-19f6a464f719 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
5872024-10-31T20:30:41.272ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 3e81276e-184e-4474-8b16-a0e7fbeeb7e4 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
5882024-10-31T20:30:41.272ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 3e81276e-184e-4474-8b16-a0e7fbeeb7e4 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
5892024-10-31T20:30:41.274ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1964 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 3e81276e-184e-4474-8b16-a0e7fbeeb7e4 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
5902024-10-31T20:30:42.295ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 96f76549-13c1-45a8-b5d2-c4be7ad003cb roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
5912024-10-31T20:30:42.296ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 96f76549-13c1-45a8-b5d2-c4be7ad003cb resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
5922024-10-31T20:30:42.298ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2429 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 96f76549-13c1-45a8-b5d2-c4be7ad003cb response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
5932024-10-31T20:30:43.318ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 44d2636f-ea64-49af-9b77-c33fb2dfb0be roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
5942024-10-31T20:30:43.318ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 44d2636f-ea64-49af-9b77-c33fb2dfb0be resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
5952024-10-31T20:30:43.320ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2025 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 44d2636f-ea64-49af-9b77-c33fb2dfb0be response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
5962024-10-31T20:30:44.340ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 6614bb0e-768a-491e-af7e-538767d56426 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
5972024-10-31T20:30:44.341ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 6614bb0e-768a-491e-af7e-538767d56426 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
5982024-10-31T20:30:44.343ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2606 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 6614bb0e-768a-491e-af7e-538767d56426 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
5992024-10-31T20:30:45.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 56865eba-f0a6-4304-998c-fb30373d4e5c roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
6002024-10-31T20:30:45.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 56865eba-f0a6-4304-998c-fb30373d4e5c resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
6012024-10-31T20:30:45.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1668 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 56865eba-f0a6-4304-998c-fb30373d4e5c response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
6022024-10-31T20:30:46.387ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 3f045d73-63d4-40e5-9ea7-0adc21d2944c roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
6032024-10-31T20:30:46.387ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 3f045d73-63d4-40e5-9ea7-0adc21d2944c resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
6042024-10-31T20:30:46.390ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2612 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 3f045d73-63d4-40e5-9ea7-0adc21d2944c response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
6052024-10-31T20:30:47.411ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 262b5ee3-3069-4623-b07c-3b71a583ee72 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
6062024-10-31T20:30:47.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 262b5ee3-3069-4623-b07c-3b71a583ee72 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
6072024-10-31T20:30:47.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2189 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 262b5ee3-3069-4623-b07c-3b71a583ee72 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
6082024-10-31T20:30:47.822ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1305 local_addr = [fd00:1122:3344:101::c]:63183 method = GET remote_addr = [fd00:1122:3344:101::d]:38560 req_id = 2cd16e7d-dd9d-4a8a-a9da-3e9c1a61d8a0 response_code = 200 uri = /d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
6092024-10-31T20:30:48.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 14b6d7d1-09c5-4651-bffb-569671ade598 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
6102024-10-31T20:30:48.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 14b6d7d1-09c5-4651-bffb-569671ade598 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
6112024-10-31T20:30:48.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2655 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 14b6d7d1-09c5-4651-bffb-569671ade598 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
6122024-10-31T20:30:48.640ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
6132024-10-31T20:30:48.640ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
6142024-10-31T20:30:48.640ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
6152024-10-31T20:30:48.640ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6162024-10-31T20:30:48.640ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
6172024-10-31T20:30:48.640ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6182024-10-31T20:30:48.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6192024-10-31T20:30:48.640ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6202024-10-31T20:30:48.640ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
6212024-10-31T20:30:48.640ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
6222024-10-31T20:30:48.640ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
6232024-10-31T20:30:48.640ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
6242024-10-31T20:30:48.640ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
6252024-10-31T20:30:48.640ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
6262024-10-31T20:30:48.640ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
6272024-10-31T20:30:48.640ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
6282024-10-31T20:30:48.640ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6292024-10-31T20:30:48.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6302024-10-31T20:30:48.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6312024-10-31T20:30:48.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6322024-10-31T20:30:48.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6332024-10-31T20:30:48.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
6342024-10-31T20:30:48.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
6352024-10-31T20:30:48.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
6362024-10-31T20:30:48.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6372024-10-31T20:30:48.641ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
6382024-10-31T20:30:48.641ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
6392024-10-31T20:30:48.641ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 9.68\u{b5}s iteration = 20 status = {"errors":[],"records_set_to_done":[]}
6402024-10-31T20:30:48.641ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 5.8\u{b5}s iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
6412024-10-31T20:30:48.641ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
6422024-10-31T20:30:48.641ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
6432024-10-31T20:30:48.641ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
6442024-10-31T20:30:48.641ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
6452024-10-31T20:30:48.641ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 4.74\u{b5}s iteration = 20 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
6462024-10-31T20:30:48.641ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
6472024-10-31T20:30:48.641ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6482024-10-31T20:30:48.641ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
6492024-10-31T20:30:48.641ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
6502024-10-31T20:30:48.641ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 9.891\u{b5}s iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
6512024-10-31T20:30:48.641ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6522024-10-31T20:30:48.641ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
6532024-10-31T20:30:48.641ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
6542024-10-31T20:30:48.641ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6552024-10-31T20:30:48.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6562024-10-31T20:30:48.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
6572024-10-31T20:30:48.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6582024-10-31T20:30:48.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6592024-10-31T20:30:48.642ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6602024-10-31T20:30:48.643ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6612024-10-31T20:30:48.643ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6622024-10-31T20:30:48.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6632024-10-31T20:30:48.644ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.5592ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
6642024-10-31T20:30:48.645ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1561, tv_nsec: 302953306 } })
6652024-10-31T20:30:48.645ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
6662024-10-31T20:30:48.646ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
6672024-10-31T20:30:48.646ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6682024-10-31T20:30:48.646ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
6692024-10-31T20:30:48.646ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6702024-10-31T20:30:48.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6712024-10-31T20:30:48.647ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
6722024-10-31T20:30:48.647ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6732024-10-31T20:30:48.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6742024-10-31T20:30:48.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6752024-10-31T20:30:48.647ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
6762024-10-31T20:30:48.647ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6772024-10-31T20:30:48.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6782024-10-31T20:30:48.649ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1561, tv_nsec: 307332793 } })
6792024-10-31T20:30:48.649ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
6802024-10-31T20:30:48.650ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6812024-10-31T20:30:48.652ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
6822024-10-31T20:30:48.652ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
6832024-10-31T20:30:48.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
6842024-10-31T20:30:48.654ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6852024-10-31T20:30:48.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6862024-10-31T20:30:48.655ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6872024-10-31T20:30:48.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6882024-10-31T20:30:48.656ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6892024-10-31T20:30:48.658ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6902024-10-31T20:30:48.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6912024-10-31T20:30:48.660ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 56b527e7-66b3-4602-a305-5dc763e7fb8b, lookup_type: ById(56b527e7-66b3-4602-a305-5dc763e7fb8b) } result = Ok(())
6922024-10-31T20:30:48.660ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6932024-10-31T20:30:48.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6942024-10-31T20:30:48.661ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1561, tv_nsec: 318841695 } })
6952024-10-31T20:30:48.661ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439
6962024-10-31T20:30:48.661ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6972024-10-31T20:30:48.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6982024-10-31T20:30:48.671ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b original_time_created = 2024-10-31 20:20:56.758465 UTC target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b time_created = 2024-10-31 20:20:56.758465 UTC
6992024-10-31T20:30:48.671ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 31.300679ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"56b527e7-66b3-4602-a305-5dc763e7fb8b","time_created":"2024-10-31T20:20:56.758465Z"}
7002024-10-31T20:30:48.679ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7012024-10-31T20:30:48.679ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
7022024-10-31T20:30:48.679ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
7032024-10-31T20:30:48.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
7042024-10-31T20:30:48.679ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7052024-10-31T20:30:48.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7062024-10-31T20:30:48.681ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7072024-10-31T20:30:48.681ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
7082024-10-31T20:30:48.681ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
7092024-10-31T20:30:48.681ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7102024-10-31T20:30:48.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
7112024-10-31T20:30:48.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7122024-10-31T20:30:48.683ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7132024-10-31T20:30:48.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7142024-10-31T20:30:48.685ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7152024-10-31T20:30:48.687ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7162024-10-31T20:30:48.688ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 622abb78-eb68-41c1-ac52-e7a263024e57, lookup_type: ById(622abb78-eb68-41c1-ac52-e7a263024e57) } result = Ok(())
7172024-10-31T20:30:48.688ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7182024-10-31T20:30:48.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7192024-10-31T20:30:48.689ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
7202024-10-31T20:30:48.689ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 49.814104ms iteration = 20 status = 0
7212024-10-31T20:30:48.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
7222024-10-31T20:30:48.690ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
7232024-10-31T20:30:48.690ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7242024-10-31T20:30:48.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7252024-10-31T20:30:48.691ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7262024-10-31T20:30:48.691ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7272024-10-31T20:30:48.694ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
7282024-10-31T20:30:48.694ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7292024-10-31T20:30:48.694ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
7302024-10-31T20:30:48.694ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7312024-10-31T20:30:48.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7322024-10-31T20:30:48.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7332024-10-31T20:30:48.695ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
7342024-10-31T20:30:48.695ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 54.644519ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
7352024-10-31T20:30:48.707ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 66.260923ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
7362024-10-31T20:30:48.709ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7372024-10-31T20:30:48.709ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
7382024-10-31T20:30:48.709ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 68.592114ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
7392024-10-31T20:30:48.717ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 76.876749ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
7402024-10-31T20:30:48.721ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7412024-10-31T20:30:48.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7422024-10-31T20:30:48.732ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
7432024-10-31T20:30:48.732ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7442024-10-31T20:30:48.732ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "43096bcf-ab08-430f-8463-be4f90c01bd7", "content-length": "26", "date": "Thu, 31 Oct 2024 20:30:47 GMT"} })
7452024-10-31T20:30:48.732ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7462024-10-31T20:30:48.734ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
7472024-10-31T20:30:48.749ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
7482024-10-31T20:30:48.749ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7492024-10-31T20:30:48.749ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1fd16e79-5270-4239-96d8-868cbd215298", "content-length": "26", "date": "Thu, 31 Oct 2024 20:30:47 GMT"} })
7502024-10-31T20:30:48.749ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7512024-10-31T20:30:48.750ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7522024-10-31T20:30:48.752ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
7532024-10-31T20:30:48.753ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7542024-10-31T20:30:48.753ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7552024-10-31T20:30:48.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7562024-10-31T20:30:48.755ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7572024-10-31T20:30:48.757ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7582024-10-31T20:30:48.757ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7592024-10-31T20:30:48.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7602024-10-31T20:30:48.768ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 zone_address = fd00:1122:3344:101::2
7612024-10-31T20:30:48.768ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7622024-10-31T20:30:48.769ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c530fe9-1ae6-4151-a68c-895954f18463", "content-length": "26", "date": "Thu, 31 Oct 2024 20:30:47 GMT"} })
7632024-10-31T20:30:48.769ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7642024-10-31T20:30:48.770ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439
7652024-10-31T20:30:48.783ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 142.888217ms iteration = 23 status = {"physical_disks_added":0}
7662024-10-31T20:30:48.861ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 221.399605ms iteration = 20 status = {}
7672024-10-31T20:30:48.893ZINFOnexus (BackgroundTasks): VPC route manager sled 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
7682024-10-31T20:30:48.893ZDEBGnexus (BackgroundTasks): client request SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7692024-10-31T20:30:48.894ZDEBGnexus (BackgroundTasks): client response SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "26f19339-4416-4424-bd54-babb91ae4db6", "content-length": "372", "date": "Thu, 31 Oct 2024 20:30:48 GMT"} })
7702024-10-31T20:30:48.894ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7712024-10-31T20:30:48.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7722024-10-31T20:30:48.916ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
7732024-10-31T20:30:48.916ZDEBGnexus (BackgroundTasks): client request SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
7742024-10-31T20:30:48.916ZDEBGnexus (BackgroundTasks): client response SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e5c596a9-68f5-47ca-ab57-499f8d7fb496", "date": "Thu, 31 Oct 2024 20:30:48 GMT"} })
7752024-10-31T20:30:48.916ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7762024-10-31T20:30:48.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7772024-10-31T20:30:48.919ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7782024-10-31T20:30:48.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7792024-10-31T20:30:48.921ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7802024-10-31T20:30:48.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7812024-10-31T20:30:48.922ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
7822024-10-31T20:30:48.922ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e412750-e958-4bc0-b26c-14b36969e846", "content-length": "1", "date": "Thu, 31 Oct 2024 20:30:48 GMT"} })
7832024-10-31T20:30:48.924ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
7842024-10-31T20:30:48.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
7852024-10-31T20:30:48.925ZINFOnexus (BackgroundTasks): VPC route manager sled 622abb78-eb68-41c1-ac52-e7a263024e57 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
7862024-10-31T20:30:48.925ZDEBGnexus (BackgroundTasks): client request SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7872024-10-31T20:30:48.925ZDEBGnexus (BackgroundTasks): client response SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ed07f03c-1387-411f-9968-975c3d2323bc", "date": "Thu, 31 Oct 2024 20:30:48 GMT"} })
7882024-10-31T20:30:48.927ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 286.273564ms iteration = 21 status = {}
7892024-10-31T20:30:48.936ZDEBGnexus (BackgroundTasks): client request SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
7902024-10-31T20:30:48.936ZDEBGnexus (BackgroundTasks): client response SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e32b6a21-b459-4d13-87d3-3a6f6484f612", "content-length": "691", "date": "Thu, 31 Oct 2024 20:30:48 GMT"} })
7912024-10-31T20:30:48.936ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
7922024-10-31T20:30:48.936ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
7932024-10-31T20:30:48.936ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
7942024-10-31T20:30:48.938ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 297.961288ms iteration = 20 status = null
7952024-10-31T20:30:48.938ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 298.61027ms iteration = 20 status = {}
7962024-10-31T20:30:48.980ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7972024-10-31T20:30:48.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7982024-10-31T20:30:48.982ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2c0ce4ae-e332-4e80-bd64-c2d6cfd99f8f, rack_id: cf9a2d24-88ed-47a2-a402-0cbbba2d1439, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(1479dccf-28ea-4cc0-9964-818390bddf17) } rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 switch_location = Switch0
7992024-10-31T20:30:48.982ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8002024-10-31T20:30:48.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8012024-10-31T20:30:48.990ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
8022024-10-31T20:30:48.991ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "6670af48-8b88-41d6-b94f-ccbc06271324", "content-length": "121", "date": "Thu, 31 Oct 2024 20:30:48 GMT"} })
8032024-10-31T20:30:48.991ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
8042024-10-31T20:30:48.991ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 1479dccf-28ea-4cc0-9964-818390bddf17
8052024-10-31T20:30:48.991ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
8062024-10-31T20:30:48.991ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
8072024-10-31T20:30:48.991ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8082024-10-31T20:30:48.991ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8092024-10-31T20:30:48.991ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8102024-10-31T20:30:48.991ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
8112024-10-31T20:30:48.991ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8122024-10-31T20:30:48.991ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
8132024-10-31T20:30:48.991ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439
8142024-10-31T20:30:48.991ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8152024-10-31T20:30:48.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8162024-10-31T20:30:48.994ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
8172024-10-31T20:30:48.994ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "a75f150d-2f69-4d23-acdf-22ab4679de17", "content-length": "2", "date": "Thu, 31 Oct 2024 20:30:48 GMT"} })
8182024-10-31T20:30:48.994ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
8192024-10-31T20:30:48.994ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a988a5a-3192-452f-b3db-1e62d36b0ac9", "content-length": "52", "date": "Thu, 31 Oct 2024 20:30:48 GMT"} })
8202024-10-31T20:30:48.994ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 switch_location = Switch0
8212024-10-31T20:30:48.994ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
8222024-10-31T20:30:49.119ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "74f7cd96-c248-4107-b8f2-4e71acb50fca", "date": "Thu, 31 Oct 2024 20:30:48 GMT"} })
8232024-10-31T20:30:49.119ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 switch = Switch0
8242024-10-31T20:30:49.119ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
8252024-10-31T20:30:49.119ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "20380dce-59e6-43fd-8b9c-ccbf3973d0f7", "content-length": "669", "date": "Thu, 31 Oct 2024 20:30:49 GMT"} })
8262024-10-31T20:30:49.119ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8272024-10-31T20:30:49.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8282024-10-31T20:30:49.123ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8292024-10-31T20:30:49.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8302024-10-31T20:30:49.127ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8312024-10-31T20:30:49.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8322024-10-31T20:30:49.129ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8332024-10-31T20:30:49.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8342024-10-31T20:30:49.137ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 497.438139ms iteration = 20 status = {}
8352024-10-31T20:30:49.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 9a7fc8cc-4041-45f6-bde4-542c8ff6b2f4 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
8362024-10-31T20:30:49.455ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 9a7fc8cc-4041-45f6-bde4-542c8ff6b2f4 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
8372024-10-31T20:30:49.457ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2111 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 9a7fc8cc-4041-45f6-bde4-542c8ff6b2f4 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
8382024-10-31T20:30:50.034ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46541 req_id = e56a3b5c-99e4-4bb8-a660-7f532037675d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
8392024-10-31T20:30:50.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46541 req_id = e56a3b5c-99e4-4bb8-a660-7f532037675d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
8402024-10-31T20:30:50.037ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3410 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46541 req_id = e56a3b5c-99e4-4bb8-a660-7f532037675d response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
8412024-10-31T20:30:50.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 1d7547d2-2bd7-4453-8ee6-4cc4649f7e4a roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
8422024-10-31T20:30:50.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 1d7547d2-2bd7-4453-8ee6-4cc4649f7e4a resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
8432024-10-31T20:30:50.479ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2169 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 1d7547d2-2bd7-4453-8ee6-4cc4649f7e4a response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
8442024-10-31T20:30:51.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 411b2f3d-274d-4557-bf0a-d9024ea527fc roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
8452024-10-31T20:30:51.499ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 411b2f3d-274d-4557-bf0a-d9024ea527fc resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
8462024-10-31T20:30:51.501ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2199 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 411b2f3d-274d-4557-bf0a-d9024ea527fc response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
8472024-10-31T20:30:52.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 94f6eaf1-065d-4820-b1ef-530c25177dda roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
8482024-10-31T20:30:52.522ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 94f6eaf1-065d-4820-b1ef-530c25177dda resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
8492024-10-31T20:30:52.524ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1916 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 94f6eaf1-065d-4820-b1ef-530c25177dda response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
8502024-10-31T20:30:53.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = e828a8c4-720d-4455-9a20-2897bc0b215c roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
8512024-10-31T20:30:53.547ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = e828a8c4-720d-4455-9a20-2897bc0b215c resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
8522024-10-31T20:30:53.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2623 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = e828a8c4-720d-4455-9a20-2897bc0b215c response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
8532024-10-31T20:30:54.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = f971b2da-ed04-4e16-924d-30e63201f23c roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
8542024-10-31T20:30:54.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = f971b2da-ed04-4e16-924d-30e63201f23c resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
8552024-10-31T20:30:54.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2134 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = f971b2da-ed04-4e16-924d-30e63201f23c response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
8562024-10-31T20:30:55.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = ced24980-dae3-4407-b477-3f1f23a0dd06 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
8572024-10-31T20:30:55.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = ced24980-dae3-4407-b477-3f1f23a0dd06 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
8582024-10-31T20:30:55.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2332 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = ced24980-dae3-4407-b477-3f1f23a0dd06 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
8592024-10-31T20:30:56.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 2101c442-4c0c-4ee4-a2d8-ebbddf25c442 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
8602024-10-31T20:30:56.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 2101c442-4c0c-4ee4-a2d8-ebbddf25c442 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
8612024-10-31T20:30:56.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2008 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 2101c442-4c0c-4ee4-a2d8-ebbddf25c442 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
8622024-10-31T20:30:57.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 7a24cf20-ad3f-4462-bf00-692d05b0c2fd roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
8632024-10-31T20:30:57.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 7a24cf20-ad3f-4462-bf00-692d05b0c2fd resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
8642024-10-31T20:30:57.642ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2781 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 7a24cf20-ad3f-4462-bf00-692d05b0c2fd response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
8652024-10-31T20:30:58.639ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
8662024-10-31T20:30:58.639ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8672024-10-31T20:30:58.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8682024-10-31T20:30:58.640ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
8692024-10-31T20:30:58.640ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8702024-10-31T20:30:58.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8712024-10-31T20:30:58.642ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8722024-10-31T20:30:58.643ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8732024-10-31T20:30:58.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8742024-10-31T20:30:58.644ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
8752024-10-31T20:30:58.644ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8762024-10-31T20:30:58.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8772024-10-31T20:30:58.647ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8782024-10-31T20:30:58.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8792024-10-31T20:30:58.651ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8802024-10-31T20:30:58.657ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 56b527e7-66b3-4602-a305-5dc763e7fb8b, lookup_type: ById(56b527e7-66b3-4602-a305-5dc763e7fb8b) } result = Ok(())
8812024-10-31T20:30:58.657ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8822024-10-31T20:30:58.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8832024-10-31T20:30:58.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 2f091731-f896-435a-9f0d-5281c37bcaf4 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
8842024-10-31T20:30:58.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 2f091731-f896-435a-9f0d-5281c37bcaf4 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
8852024-10-31T20:30:58.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1828 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 2f091731-f896-435a-9f0d-5281c37bcaf4 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
8862024-10-31T20:30:58.670ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b original_time_created = 2024-10-31 20:20:56.758465 UTC target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b time_created = 2024-10-31 20:20:56.758465 UTC
8872024-10-31T20:30:58.670ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 30.377804ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"56b527e7-66b3-4602-a305-5dc763e7fb8b","time_created":"2024-10-31T20:20:56.758465Z"}
8882024-10-31T20:30:58.682ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 41.925416ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
8892024-10-31T20:30:59.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 161849f7-8348-4b49-bb1c-ec179069ef63 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
8902024-10-31T20:30:59.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 161849f7-8348-4b49-bb1c-ec179069ef63 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
8912024-10-31T20:30:59.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2263 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 161849f7-8348-4b49-bb1c-ec179069ef63 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
8922024-10-31T20:31:00.710ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = d304e5d5-20e9-42db-9535-9ad6d41d178f roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
8932024-10-31T20:31:00.711ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = d304e5d5-20e9-42db-9535-9ad6d41d178f resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
8942024-10-31T20:31:00.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2004 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = d304e5d5-20e9-42db-9535-9ad6d41d178f response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
8952024-10-31T20:31:01.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 9e448ad5-17b6-4ae0-b232-ae22dbc246fd roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
8962024-10-31T20:31:01.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 9e448ad5-17b6-4ae0-b232-ae22dbc246fd resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
8972024-10-31T20:31:01.737ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2374 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 9e448ad5-17b6-4ae0-b232-ae22dbc246fd response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
8982024-10-31T20:31:02.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 11cfa779-3100-4101-9b7f-19c7bdb0a53c roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
8992024-10-31T20:31:02.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 11cfa779-3100-4101-9b7f-19c7bdb0a53c resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
9002024-10-31T20:31:02.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2746 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 11cfa779-3100-4101-9b7f-19c7bdb0a53c response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
9012024-10-31T20:31:02.822ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1240 local_addr = [fd00:1122:3344:101::c]:63183 method = GET remote_addr = [fd00:1122:3344:101::d]:38560 req_id = 23b865aa-1dfc-4c27-a467-7d143a3c55d6 response_code = 200 uri = /d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
9022024-10-31T20:31:03.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = b5fdf5e7-bcbf-47cb-ba9e-82230614b88c roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
9032024-10-31T20:31:03.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = b5fdf5e7-bcbf-47cb-ba9e-82230614b88c resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
9042024-10-31T20:31:03.783ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2144 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = b5fdf5e7-bcbf-47cb-ba9e-82230614b88c response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
9052024-10-31T20:31:04.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = ecb08ba5-9850-484a-9a6d-923ab40ef255 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
9062024-10-31T20:31:04.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = ecb08ba5-9850-484a-9a6d-923ab40ef255 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
9072024-10-31T20:31:04.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2013 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = ecb08ba5-9850-484a-9a6d-923ab40ef255 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
9082024-10-31T20:31:05.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = fecc58f8-0c3b-49c0-8757-b9cb4c39fb4a roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
9092024-10-31T20:31:05.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = fecc58f8-0c3b-49c0-8757-b9cb4c39fb4a resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
9102024-10-31T20:31:05.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2297 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = fecc58f8-0c3b-49c0-8757-b9cb4c39fb4a response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
9112024-10-31T20:31:06.847ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = c7b29d91-c601-439b-b8be-dfc024caba99 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
9122024-10-31T20:31:06.848ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = c7b29d91-c601-439b-b8be-dfc024caba99 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
9132024-10-31T20:31:06.849ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1980 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = c7b29d91-c601-439b-b8be-dfc024caba99 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
9142024-10-31T20:31:07.815ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:41912
9152024-10-31T20:31:07.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = 34669e91-991d-4d52-b7a9-269309e442d7 roles = RoleSet { roles: {} } uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?sort_by=id_ascending
9162024-10-31T20:31:07.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = 34669e91-991d-4d52-b7a9-269309e442d7 resource = Database result = Ok(()) uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?sort_by=id_ascending
9172024-10-31T20:31:07.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2722 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = 34669e91-991d-4d52-b7a9-269309e442d7 response_code = 200 uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?sort_by=id_ascending
9182024-10-31T20:31:07.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = 21ef9fb5-7375-4569-9b19-543cf7113676 roles = RoleSet { roles: {} } uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzA4NDI3Ny1iNmFhLTQ1OWYtOGY4MS1mNGVmNGM3Yzg0M2UifX0%3D
9192024-10-31T20:31:07.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = 21ef9fb5-7375-4569-9b19-543cf7113676 resource = Database result = Ok(()) uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzA4NDI3Ny1iNmFhLTQ1OWYtOGY4MS1mNGVmNGM3Yzg0M2UifX0%3D
9202024-10-31T20:31:07.820ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2292 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = 21ef9fb5-7375-4569-9b19-543cf7113676 response_code = 200 uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzA4NDI3Ny1iNmFhLTQ1OWYtOGY4MS1mNGVmNGM3Yzg0M2UifX0%3D
9212024-10-31T20:31:07.871ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 80f030a4-dd67-43c3-99c1-20399f84e18e roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
9222024-10-31T20:31:07.871ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 80f030a4-dd67-43c3-99c1-20399f84e18e resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
9232024-10-31T20:31:07.872ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1794 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 80f030a4-dd67-43c3-99c1-20399f84e18e response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
9242024-10-31T20:31:08.639ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
9252024-10-31T20:31:08.639ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9262024-10-31T20:31:08.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9272024-10-31T20:31:08.640ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
9282024-10-31T20:31:08.640ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9292024-10-31T20:31:08.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9302024-10-31T20:31:08.642ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9312024-10-31T20:31:08.642ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9322024-10-31T20:31:08.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9332024-10-31T20:31:08.644ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9342024-10-31T20:31:08.644ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9352024-10-31T20:31:08.644ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.072491ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9362024-10-31T20:31:08.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9372024-10-31T20:31:08.647ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9382024-10-31T20:31:08.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9392024-10-31T20:31:08.649ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9402024-10-31T20:31:08.651ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 56b527e7-66b3-4602-a305-5dc763e7fb8b, lookup_type: ById(56b527e7-66b3-4602-a305-5dc763e7fb8b) } result = Ok(())
9412024-10-31T20:31:08.651ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9422024-10-31T20:31:08.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9432024-10-31T20:31:08.663ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b original_time_created = 2024-10-31 20:20:56.758465 UTC target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b time_created = 2024-10-31 20:20:56.758465 UTC
9442024-10-31T20:31:08.663ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.557773ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"56b527e7-66b3-4602-a305-5dc763e7fb8b","time_created":"2024-10-31T20:20:56.758465Z"}
9452024-10-31T20:31:08.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 719f94cc-a8de-444a-957a-6b49fb407b7e roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
9462024-10-31T20:31:08.896ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 719f94cc-a8de-444a-957a-6b49fb407b7e resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
9472024-10-31T20:31:08.897ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2495 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 719f94cc-a8de-444a-957a-6b49fb407b7e response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
9482024-10-31T20:31:09.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = ab0f14a0-f352-4320-87f8-664bf6720326 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
9492024-10-31T20:31:09.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = ab0f14a0-f352-4320-87f8-664bf6720326 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
9502024-10-31T20:31:09.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2756 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = ab0f14a0-f352-4320-87f8-664bf6720326 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
9512024-10-31T20:31:10.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 2b6d8e13-15a0-4d91-af98-867926bbc1ae roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
9522024-10-31T20:31:10.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 2b6d8e13-15a0-4d91-af98-867926bbc1ae resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
9532024-10-31T20:31:10.942ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1521 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 2b6d8e13-15a0-4d91-af98-867926bbc1ae response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
9542024-10-31T20:31:11.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 02e85e2b-19d9-4d02-9052-464b843c5b8d roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
9552024-10-31T20:31:11.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 02e85e2b-19d9-4d02-9052-464b843c5b8d resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
9562024-10-31T20:31:11.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2042 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 02e85e2b-19d9-4d02-9052-464b843c5b8d response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
9572024-10-31T20:31:12.988ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 3cf948a6-4295-42af-b734-e489f3901c81 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
9582024-10-31T20:31:12.988ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 3cf948a6-4295-42af-b734-e489f3901c81 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
9592024-10-31T20:31:12.990ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2377 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 3cf948a6-4295-42af-b734-e489f3901c81 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
9602024-10-31T20:31:14.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 0bb3db06-695b-44e4-83c6-0b6139e4cc3d roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
9612024-10-31T20:31:14.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 0bb3db06-695b-44e4-83c6-0b6139e4cc3d resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
9622024-10-31T20:31:14.014ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2303 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 0bb3db06-695b-44e4-83c6-0b6139e4cc3d response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
9632024-10-31T20:31:15.034ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 924335b9-2853-47ab-967b-9b520174feae roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
9642024-10-31T20:31:15.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 924335b9-2853-47ab-967b-9b520174feae resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
9652024-10-31T20:31:15.036ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2357 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 924335b9-2853-47ab-967b-9b520174feae response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
9662024-10-31T20:31:16.058ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = ffd5bf89-8cc2-4346-85b7-833ab48a4cb6 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
9672024-10-31T20:31:16.058ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = ffd5bf89-8cc2-4346-85b7-833ab48a4cb6 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
9682024-10-31T20:31:16.060ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2060 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = ffd5bf89-8cc2-4346-85b7-833ab48a4cb6 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
9692024-10-31T20:31:17.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 13e0fd31-5b6b-4766-949b-37d84b39fb54 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
9702024-10-31T20:31:17.083ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 13e0fd31-5b6b-4766-949b-37d84b39fb54 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
9712024-10-31T20:31:17.085ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2507 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 13e0fd31-5b6b-4766-949b-37d84b39fb54 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
9722024-10-31T20:31:17.823ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1349 local_addr = [fd00:1122:3344:101::c]:63183 method = GET remote_addr = [fd00:1122:3344:101::d]:38560 req_id = b69d60a3-271a-469f-9b95-a3ad9af125d2 response_code = 200 uri = /d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
9732024-10-31T20:31:18.106ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 0216de29-1813-489d-942b-a8a8480ab7c1 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
9742024-10-31T20:31:18.106ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 0216de29-1813-489d-942b-a8a8480ab7c1 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
9752024-10-31T20:31:18.108ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2325 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 0216de29-1813-489d-942b-a8a8480ab7c1 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
9762024-10-31T20:31:18.640ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
9772024-10-31T20:31:18.640ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-10-31 20:21:18.640604793 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
9782024-10-31T20:31:18.640ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
9792024-10-31T20:31:18.640ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
9802024-10-31T20:31:18.640ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
9812024-10-31T20:31:18.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9822024-10-31T20:31:18.640ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9832024-10-31T20:31:18.640ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
9842024-10-31T20:31:18.640ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
9852024-10-31T20:31:18.640ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9862024-10-31T20:31:18.640ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
9872024-10-31T20:31:18.640ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
9882024-10-31T20:31:18.640ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
9892024-10-31T20:31:18.640ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
9902024-10-31T20:31:18.640ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
9912024-10-31T20:31:18.640ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
9922024-10-31T20:31:18.640ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
9932024-10-31T20:31:18.640ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
9942024-10-31T20:31:18.640ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
9952024-10-31T20:31:18.640ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9962024-10-31T20:31:18.640ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
9972024-10-31T20:31:18.640ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
9982024-10-31T20:31:18.640ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Timeout
9992024-10-31T20:31:18.640ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10002024-10-31T20:31:18.640ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
10012024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
10022024-10-31T20:31:18.641ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b
10032024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 17.51\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"56b527e7-66b3-4602-a305-5dc763e7fb8b"}
10042024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
10052024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
10062024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
10072024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
10082024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
10092024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
10102024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
10112024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
10122024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
10132024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
10142024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
10152024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
10162024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10172024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 13.56\u{b5}s iteration = 21 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
10182024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
10192024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
10202024-10-31T20:31:18.641ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
10212024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
10222024-10-31T20:31:18.641ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
10232024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
10242024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
10252024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
10262024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10272024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
10282024-10-31T20:31:18.641ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
10292024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10302024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
10312024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 14.62\u{b5}s iteration = 21 status = {"errors":[],"records_set_to_done":[]}
10322024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
10332024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
10342024-10-31T20:31:18.641ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
10352024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10362024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
10372024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
10382024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 16.63\u{b5}s iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
10392024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
10402024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.96\u{b5}s iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
10412024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
10422024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
10432024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10442024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10452024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10462024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
10472024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10482024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
10492024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10502024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
10512024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
10522024-10-31T20:31:18.641ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
10532024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
10542024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
10552024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10562024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
10572024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10582024-10-31T20:31:18.641ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8e750a05-d6dd-412d-aac1-b776b5e7757f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8e764cc9-00d9-46ed-80f0-316c9e4e0a2b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f87fba37-8eb7-413a-91fe-8caa94515963.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f87fba37-8eb7-413a-91fe-8caa94515963.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1591, tv_nsec: 299299102 } })
10592024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10602024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10612024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
10622024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
10632024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
10642024-10-31T20:31:18.641ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("02376501-3235-4cfe-a1cd-82b53358d277.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a8364658-9f18-48ec-a891-264e5c9fbbb6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("a8364658-9f18-48ec-a891-264e5c9fbbb6.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1591, tv_nsec: 299413885 } })
10652024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
10662024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10672024-10-31T20:31:18.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
10682024-10-31T20:31:18.642ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
10692024-10-31T20:31:18.642ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.73712ms iteration = 12 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
10702024-10-31T20:31:18.642ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
10712024-10-31T20:31:18.642ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.603338ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
10722024-10-31T20:31:18.644ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10732024-10-31T20:31:18.644ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.614773ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
10742024-10-31T20:31:18.644ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
10752024-10-31T20:31:18.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
10762024-10-31T20:31:18.645ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-10-31 20:21:18.640604793 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
10772024-10-31T20:31:18.645ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.601931ms iteration = 11 status = {"expiration":"2024-10-31T20:21:18.640604793Z","pruned":[]}
10782024-10-31T20:31:18.645ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10792024-10-31T20:31:18.646ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10802024-10-31T20:31:18.647ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
10812024-10-31T20:31:18.647ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10822024-10-31T20:31:18.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10832024-10-31T20:31:18.648ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
10842024-10-31T20:31:18.648ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10852024-10-31T20:31:18.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10862024-10-31T20:31:18.649ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10872024-10-31T20:31:18.649ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10882024-10-31T20:31:18.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10892024-10-31T20:31:18.650ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10902024-10-31T20:31:18.651ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10912024-10-31T20:31:18.651ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10922024-10-31T20:31:18.651ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1591, tv_nsec: 309442420 } })
10932024-10-31T20:31:18.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10942024-10-31T20:31:18.652ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
10952024-10-31T20:31:18.652ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
10962024-10-31T20:31:18.652ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
10972024-10-31T20:31:18.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
10982024-10-31T20:31:18.653ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
10992024-10-31T20:31:18.653ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11002024-10-31T20:31:18.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11012024-10-31T20:31:18.654ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1591, tv_nsec: 312305911 } })
11022024-10-31T20:31:18.655ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
11032024-10-31T20:31:18.655ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
11042024-10-31T20:31:18.655ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11052024-10-31T20:31:18.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11062024-10-31T20:31:18.655ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
11072024-10-31T20:31:18.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
11082024-10-31T20:31:18.656ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 15.555613ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
11092024-10-31T20:31:18.658ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
11102024-10-31T20:31:18.658ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11112024-10-31T20:31:18.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11122024-10-31T20:31:18.659ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11132024-10-31T20:31:18.660ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11142024-10-31T20:31:18.661ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11152024-10-31T20:31:18.662ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
11162024-10-31T20:31:18.662ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
11172024-10-31T20:31:18.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11182024-10-31T20:31:18.662ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
11192024-10-31T20:31:18.662ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
11202024-10-31T20:31:18.662ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 20.987818ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
11212024-10-31T20:31:18.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
11222024-10-31T20:31:18.663ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
11232024-10-31T20:31:18.664ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 23.716396ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
11242024-10-31T20:31:18.664ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11252024-10-31T20:31:18.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11262024-10-31T20:31:18.665ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1591, tv_nsec: 322734574 } })
11272024-10-31T20:31:18.665ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439
11282024-10-31T20:31:18.666ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11292024-10-31T20:31:18.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11302024-10-31T20:31:18.666ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
11312024-10-31T20:31:18.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11322024-10-31T20:31:18.666ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11332024-10-31T20:31:18.667ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11342024-10-31T20:31:18.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11352024-10-31T20:31:18.671ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
11362024-10-31T20:31:18.675ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11372024-10-31T20:31:18.678ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
11382024-10-31T20:31:18.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11392024-10-31T20:31:18.682ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
11402024-10-31T20:31:18.682ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11412024-10-31T20:31:18.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11422024-10-31T20:31:18.685ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11432024-10-31T20:31:18.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11442024-10-31T20:31:18.695ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
11452024-10-31T20:31:18.695ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = b4ed75ec-fe3b-45b1-8d9e-63c6be8552b4
11462024-10-31T20:31:18.695ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 4c4c12d5-6f47-4317-901e-1facdc7b0faf
11472024-10-31T20:31:18.695ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 288154ac-48ca-49ca-ac8a-2cd275af3816
11482024-10-31T20:31:18.695ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 288154ac-48ca-49ca-ac8a-2cd275af3816
11492024-10-31T20:31:18.695ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 4c4c12d5-6f47-4317-901e-1facdc7b0faf
11502024-10-31T20:31:18.695ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = b4ed75ec-fe3b-45b1-8d9e-63c6be8552b4
11512024-10-31T20:31:18.695ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11522024-10-31T20:31:18.697ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
11532024-10-31T20:31:18.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
11542024-10-31T20:31:18.698ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
11552024-10-31T20:31:18.698ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11562024-10-31T20:31:18.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11572024-10-31T20:31:18.699ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11582024-10-31T20:31:18.699ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
11592024-10-31T20:31:18.699ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11602024-10-31T20:31:18.699ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 58.037558ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":3,"recent_failures":[],"recent_recoveries":[]}
11612024-10-31T20:31:18.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11622024-10-31T20:31:18.701ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 60.622104ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
11632024-10-31T20:31:18.705ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
11642024-10-31T20:31:18.705ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
11652024-10-31T20:31:18.705ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
11662024-10-31T20:31:18.705ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
11672024-10-31T20:31:18.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
11682024-10-31T20:31:18.707ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11692024-10-31T20:31:18.710ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
11702024-10-31T20:31:18.710ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
11712024-10-31T20:31:18.710ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 70.054819ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
11722024-10-31T20:31:18.711ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
11732024-10-31T20:31:18.711ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
11742024-10-31T20:31:18.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
11752024-10-31T20:31:18.712ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11762024-10-31T20:31:18.712ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11772024-10-31T20:31:18.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11782024-10-31T20:31:18.713ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
11792024-10-31T20:31:18.713ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
11802024-10-31T20:31:18.713ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
11812024-10-31T20:31:18.713ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
11822024-10-31T20:31:18.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
11832024-10-31T20:31:18.714ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
11842024-10-31T20:31:18.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11852024-10-31T20:31:18.715ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 56b527e7-66b3-4602-a305-5dc763e7fb8b, lookup_type: ById(56b527e7-66b3-4602-a305-5dc763e7fb8b) } result = Ok(())
11862024-10-31T20:31:18.715ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11872024-10-31T20:31:18.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11882024-10-31T20:31:18.716ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11892024-10-31T20:31:18.717ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11902024-10-31T20:31:18.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11912024-10-31T20:31:18.718ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11922024-10-31T20:31:18.721ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
11932024-10-31T20:31:18.721ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11942024-10-31T20:31:18.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11952024-10-31T20:31:18.721ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
11962024-10-31T20:31:18.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11972024-10-31T20:31:18.722ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
11982024-10-31T20:31:18.722ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 81.249116ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
11992024-10-31T20:31:18.723ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
12002024-10-31T20:31:18.723ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12012024-10-31T20:31:18.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12022024-10-31T20:31:18.724ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12032024-10-31T20:31:18.725ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12042024-10-31T20:31:18.727ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 622abb78-eb68-41c1-ac52-e7a263024e57, lookup_type: ById(622abb78-eb68-41c1-ac52-e7a263024e57) } result = Ok(())
12052024-10-31T20:31:18.727ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12062024-10-31T20:31:18.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12072024-10-31T20:31:18.729ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 88.962061ms iteration = 21 status = 0
12082024-10-31T20:31:18.731ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
12092024-10-31T20:31:18.731ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12102024-10-31T20:31:18.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12112024-10-31T20:31:18.732ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12122024-10-31T20:31:18.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12132024-10-31T20:31:18.732ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12142024-10-31T20:31:18.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12152024-10-31T20:31:18.733ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12162024-10-31T20:31:18.733ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
12172024-10-31T20:31:18.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
12182024-10-31T20:31:18.734ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12192024-10-31T20:31:18.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12202024-10-31T20:31:18.734ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b original_time_created = 2024-10-31 20:20:56.758465 UTC target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b time_created = 2024-10-31 20:20:56.758465 UTC
12212024-10-31T20:31:18.734ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 94.180662ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"56b527e7-66b3-4602-a305-5dc763e7fb8b","time_created":"2024-10-31T20:20:56.758465Z"}
12222024-10-31T20:31:18.735ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
12232024-10-31T20:31:18.735ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12242024-10-31T20:31:18.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12252024-10-31T20:31:18.736ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12262024-10-31T20:31:18.737ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12272024-10-31T20:31:18.738ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12282024-10-31T20:31:18.739ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
12292024-10-31T20:31:18.739ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
12302024-10-31T20:31:18.739ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
12312024-10-31T20:31:18.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12322024-10-31T20:31:18.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
12332024-10-31T20:31:18.739ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
12342024-10-31T20:31:18.739ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12352024-10-31T20:31:18.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12362024-10-31T20:31:18.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
12372024-10-31T20:31:18.740ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12382024-10-31T20:31:18.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12392024-10-31T20:31:18.742ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12402024-10-31T20:31:18.743ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
12412024-10-31T20:31:18.743ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12422024-10-31T20:31:18.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12432024-10-31T20:31:18.744ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12442024-10-31T20:31:18.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12452024-10-31T20:31:18.745ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12462024-10-31T20:31:18.746ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12472024-10-31T20:31:18.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12482024-10-31T20:31:18.747ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
12492024-10-31T20:31:18.747ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12502024-10-31T20:31:18.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12512024-10-31T20:31:18.748ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12522024-10-31T20:31:18.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12532024-10-31T20:31:18.749ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
12542024-10-31T20:31:18.749ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 1a5173f7-64b4-48db-9160-caa5913594e3 dns_zone_name = oxide.test found_so_far = 0 version = 2
12552024-10-31T20:31:18.749ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
12562024-10-31T20:31:18.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
12572024-10-31T20:31:18.749ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12582024-10-31T20:31:18.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12592024-10-31T20:31:18.750ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12602024-10-31T20:31:18.753ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
12612024-10-31T20:31:18.753ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
12622024-10-31T20:31:18.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
12632024-10-31T20:31:18.754ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
12642024-10-31T20:31:18.754ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 9bbba0df-c792-4ba2-925b-ab02ed6483a1 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
12652024-10-31T20:31:18.754ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12662024-10-31T20:31:18.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12672024-10-31T20:31:18.759ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
12682024-10-31T20:31:18.759ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 119.11182ms iteration = 24 status = {"physical_disks_added":0}
12692024-10-31T20:31:18.773ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
12702024-10-31T20:31:18.773ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
12712024-10-31T20:31:18.773ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 132.17227ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
12722024-10-31T20:31:18.787ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-10-31T20:21:09.823788Z, time_modified: 2024-10-31T20:21:09.823788Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9efc5118-5ea4-4fe1-a8c5-501dee3e98c0, db_silo: Silo { identity: SiloIdentity { id: 9efc5118-5ea4-4fe1-a8c5-501dee3e98c0, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-31T20:21:23.039241Z, time_modified: 2024-10-31T20:21:23.039241Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "fffc2e5c59e415981668ee3af9418c2de014d1976b7a03713830fdf9f35a71e6" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9efc5118-5ea4-4fe1-a8c5-501dee3e98c0, db_silo: Silo { identity: SiloIdentity { id: 9efc5118-5ea4-4fe1-a8c5-501dee3e98c0, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-31T20:21:23.039241Z, time_modified: 2024-10-31T20:21:23.039241Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "fffc2e5c59e415981668ee3af9418c2de014d1976b7a03713830fdf9f35a71e6" }] }) }
12732024-10-31T20:31:18.787ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 146.989109ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9efc5118-5ea4-4fe1-a8c5-501dee3e98c0","tls_certs":["fffc2e5c59e415981668ee3af9418c2de014d1976b7a03713830fdf9f35a71e6"]}},"default_endpoint":{"silo_id":"9efc5118-5ea4-4fe1-a8c5-501dee3e98c0","tls_certs":["fffc2e5c59e415981668ee3af9418c2de014d1976b7a03713830fdf9f35a71e6"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
12742024-10-31T20:31:18.789ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
12752024-10-31T20:31:18.790ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12762024-10-31T20:31:18.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12772024-10-31T20:31:18.799ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
12782024-10-31T20:31:18.799ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12792024-10-31T20:31:18.799ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e753e43e-3b13-4a6d-bdb8-ea401819a86c", "content-length": "26", "date": "Thu, 31 Oct 2024 20:31:18 GMT"} })
12802024-10-31T20:31:18.799ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12812024-10-31T20:31:18.801ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
12822024-10-31T20:31:18.804ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
12832024-10-31T20:31:18.804ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12842024-10-31T20:31:18.804ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "66d5557f-6bbe-426a-9cd4-2f465168b1e5", "content-length": "26", "date": "Thu, 31 Oct 2024 20:31:18 GMT"} })
12852024-10-31T20:31:18.804ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12862024-10-31T20:31:18.806ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
12872024-10-31T20:31:18.821ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 zone_address = fd00:1122:3344:101::2
12882024-10-31T20:31:18.821ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12892024-10-31T20:31:18.822ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7aa3dcb1-76ce-4669-a116-ee9cfadace7f", "content-length": "26", "date": "Thu, 31 Oct 2024 20:31:18 GMT"} })
12902024-10-31T20:31:18.822ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12912024-10-31T20:31:18.823ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439
12922024-10-31T20:31:18.829ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
12932024-10-31T20:31:18.829ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 188.58866ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
12942024-10-31T20:31:18.973ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
12952024-10-31T20:31:18.973ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "cdd9a127-e11d-4853-8bce-bccc46beb1c2", "date": "Thu, 31 Oct 2024 20:31:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
12962024-10-31T20:31:18.973ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
12972024-10-31T20:31:18.974ZDEBGnexus (BackgroundTasks): client request SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
12982024-10-31T20:31:18.974ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
12992024-10-31T20:31:18.974ZDEBGnexus (BackgroundTasks): client response SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e867c12a-22b8-4bf9-9cb1-d17183c7acaf", "content-length": "691", "date": "Thu, 31 Oct 2024 20:31:18 GMT"} })
13002024-10-31T20:31:18.974ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
13012024-10-31T20:31:18.974ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
13022024-10-31T20:31:18.974ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
13032024-10-31T20:31:18.981ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "a4dcaea8-398b-4d19-afd0-be55b79748dd", "date": "Thu, 31 Oct 2024 20:31:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
13042024-10-31T20:31:18.981ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
13052024-10-31T20:31:18.983ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 342.547351ms iteration = 21 status = {}
13062024-10-31T20:31:18.984ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
13072024-10-31T20:31:18.984ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 343.62474ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
13082024-10-31T20:31:18.997ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 356.572377ms iteration = 21 status = {}
13092024-10-31T20:31:19.001ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
13102024-10-31T20:31:19.002ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "14a3007a-9d46-427c-aa01-73418ce08c68", "content-length": "1", "date": "Thu, 31 Oct 2024 20:31:18 GMT"} })
13112024-10-31T20:31:19.004ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
13122024-10-31T20:31:19.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
13132024-10-31T20:31:19.058ZINFOnexus (BackgroundTasks): VPC route manager sled 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
13142024-10-31T20:31:19.058ZDEBGnexus (BackgroundTasks): client request SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
13152024-10-31T20:31:19.059ZDEBGnexus (BackgroundTasks): client response SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a7d0e8d0-0d67-49df-9066-31f9b44e5599", "content-length": "372", "date": "Thu, 31 Oct 2024 20:31:18 GMT"} })
13162024-10-31T20:31:19.059ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13172024-10-31T20:31:19.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13182024-10-31T20:31:19.069ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 1a5173f7-64b4-48db-9160-caa5913594e3 dns_zone_name = oxide.test found_so_far = 1 version = 2
13192024-10-31T20:31:19.069ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
13202024-10-31T20:31:19.069ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-10-31 20:21:23.098854 UTC dns_group = external generation = 2
13212024-10-31T20:31:19.069ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 429.13699ms iteration = 12 status = {"generation":2}
13222024-10-31T20:31:19.071ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13232024-10-31T20:31:19.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13242024-10-31T20:31:19.080ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 439.448751ms iteration = 21 status = null
13252024-10-31T20:31:19.096ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
13262024-10-31T20:31:19.097ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "61415d24-b42b-4e14-8680-9407d782e4d5", "date": "Thu, 31 Oct 2024 20:31:19 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
13272024-10-31T20:31:19.097ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
13282024-10-31T20:31:19.099ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "b4b4d611-fda4-463c-b5b8-353260eba628", "date": "Thu, 31 Oct 2024 20:31:19 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
13292024-10-31T20:31:19.099ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
13302024-10-31T20:31:19.101ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "f31bfda3-a52d-4830-8243-c8bfabc4e0f1", "date": "Thu, 31 Oct 2024 20:31:19 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
13312024-10-31T20:31:19.101ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
13322024-10-31T20:31:19.103ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
13332024-10-31T20:31:19.103ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 462.709509ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
13342024-10-31T20:31:19.129ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13352024-10-31T20:31:19.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 0f428a12-6fb8-46b8-997c-47165a34b467 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
13362024-10-31T20:31:19.130ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 0f428a12-6fb8-46b8-997c-47165a34b467 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
13372024-10-31T20:31:19.133ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
13382024-10-31T20:31:19.133ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13392024-10-31T20:31:19.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3505 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 0f428a12-6fb8-46b8-997c-47165a34b467 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
13402024-10-31T20:31:19.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13412024-10-31T20:31:19.136ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 9bbba0df-c792-4ba2-925b-ab02ed6483a1 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
13422024-10-31T20:31:19.136ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
13432024-10-31T20:31:19.136ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-10-31 20:21:21.652645 UTC dns_group = internal generation = 1
13442024-10-31T20:31:19.136ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 495.683638ms iteration = 12 status = {"generation":1}
13452024-10-31T20:31:19.137ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13462024-10-31T20:31:19.137ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
13472024-10-31T20:31:19.137ZDEBGnexus (BackgroundTasks): client request SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
13482024-10-31T20:31:19.141ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
13492024-10-31T20:31:19.141ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13502024-10-31T20:31:19.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13512024-10-31T20:31:19.143ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13522024-10-31T20:31:19.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13532024-10-31T20:31:19.143ZDEBGnexus (BackgroundTasks): client response SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "5e757cec-b304-408c-bb17-b3c137e3a12d", "date": "Thu, 31 Oct 2024 20:31:18 GMT"} })
13542024-10-31T20:31:19.143ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13552024-10-31T20:31:19.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13562024-10-31T20:31:19.146ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13572024-10-31T20:31:19.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13582024-10-31T20:31:19.146ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13592024-10-31T20:31:19.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13602024-10-31T20:31:19.154ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13612024-10-31T20:31:19.154ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13622024-10-31T20:31:19.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13632024-10-31T20:31:19.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13642024-10-31T20:31:19.157ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13652024-10-31T20:31:19.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13662024-10-31T20:31:19.158ZINFOnexus (BackgroundTasks): VPC route manager sled 622abb78-eb68-41c1-ac52-e7a263024e57 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
13672024-10-31T20:31:19.158ZDEBGnexus (BackgroundTasks): client request SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
13682024-10-31T20:31:19.159ZDEBGnexus (BackgroundTasks): client response SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "51e6024b-19f0-4fb5-93a9-79c260439716", "date": "Thu, 31 Oct 2024 20:31:18 GMT"} })
13692024-10-31T20:31:19.159ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13702024-10-31T20:31:19.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13712024-10-31T20:31:19.161ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13722024-10-31T20:31:19.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13732024-10-31T20:31:19.161ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 520.467232ms iteration = 22 status = {}
13742024-10-31T20:31:19.164ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13752024-10-31T20:31:19.169ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
13762024-10-31T20:31:19.169ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
13772024-10-31T20:31:19.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
13782024-10-31T20:31:19.182ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13792024-10-31T20:31:19.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13802024-10-31T20:31:19.185ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2c0ce4ae-e332-4e80-bd64-c2d6cfd99f8f, rack_id: cf9a2d24-88ed-47a2-a402-0cbbba2d1439, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(1479dccf-28ea-4cc0-9964-818390bddf17) } rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 switch_location = Switch0
13812024-10-31T20:31:19.185ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13822024-10-31T20:31:19.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13832024-10-31T20:31:19.196ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
13842024-10-31T20:31:19.196ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "822821b7-2044-4031-af08-f1bda46988d4", "content-length": "121", "date": "Thu, 31 Oct 2024 20:31:18 GMT"} })
13852024-10-31T20:31:19.196ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
13862024-10-31T20:31:19.196ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 1479dccf-28ea-4cc0-9964-818390bddf17
13872024-10-31T20:31:19.197ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
13882024-10-31T20:31:19.197ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
13892024-10-31T20:31:19.197ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
13902024-10-31T20:31:19.197ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
13912024-10-31T20:31:19.197ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
13922024-10-31T20:31:19.197ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
13932024-10-31T20:31:19.197ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
13942024-10-31T20:31:19.197ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
13952024-10-31T20:31:19.197ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439
13962024-10-31T20:31:19.197ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13972024-10-31T20:31:19.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13982024-10-31T20:31:19.200ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
13992024-10-31T20:31:19.200ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7348545e-772a-4981-bf69-db0914810c2c", "content-length": "2", "date": "Thu, 31 Oct 2024 20:31:18 GMT"} })
14002024-10-31T20:31:19.200ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
14012024-10-31T20:31:19.200ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "653c26c2-c167-4de6-bd1d-a43d449e3017", "content-length": "52", "date": "Thu, 31 Oct 2024 20:31:18 GMT"} })
14022024-10-31T20:31:19.200ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 switch_location = Switch0
14032024-10-31T20:31:19.200ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
14042024-10-31T20:31:19.209ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14052024-10-31T20:31:19.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14062024-10-31T20:31:19.211ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14072024-10-31T20:31:19.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14082024-10-31T20:31:19.213ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14092024-10-31T20:31:19.217ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
14102024-10-31T20:31:19.217ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14112024-10-31T20:31:19.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14122024-10-31T20:31:19.221ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14132024-10-31T20:31:19.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14142024-10-31T20:31:19.223ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14152024-10-31T20:31:19.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14162024-10-31T20:31:19.225ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14172024-10-31T20:31:19.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14182024-10-31T20:31:19.227ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14192024-10-31T20:31:19.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14202024-10-31T20:31:19.228ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:54810
14212024-10-31T20:31:19.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54810 req_id = 34aacfd2-12da-4bce-a0eb-cea27f87a40d roles = RoleSet { roles: {} } uri = /metrics/producers
14222024-10-31T20:31:19.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54810 req_id = 34aacfd2-12da-4bce-a0eb-cea27f87a40d resource = Database result = Ok(()) uri = /metrics/producers
14232024-10-31T20:31:19.229ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14242024-10-31T20:31:19.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14252024-10-31T20:31:19.231ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14262024-10-31T20:31:19.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14272024-10-31T20:31:19.232ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14282024-10-31T20:31:19.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14292024-10-31T20:31:19.234ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14302024-10-31T20:31:19.239ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
14312024-10-31T20:31:19.239ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14322024-10-31T20:31:19.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14332024-10-31T20:31:19.241ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14342024-10-31T20:31:19.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14352024-10-31T20:31:19.273ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14362024-10-31T20:31:19.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14372024-10-31T20:31:19.275ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14382024-10-31T20:31:19.280ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
14392024-10-31T20:31:19.280ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14402024-10-31T20:31:19.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14412024-10-31T20:31:19.282ZINFOnexus: assigned collector to new producer collector_id = 6e71f19b-440f-4a40-bbbb-fa1de5a7e58c file = nexus/src/app/oximeter.rs:76 producer_id = 8e92f635-c267-4817-ab48-5ce3a797cb1d
14422024-10-31T20:31:19.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 54733 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54810 req_id = 34aacfd2-12da-4bce-a0eb-cea27f87a40d response_code = 201 uri = /metrics/producers
14432024-10-31T20:31:19.287ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 3f4f0287-3e1d-43e4-92d4-51818f19aeea, kind: Service { id: a8364658-9f18-48ec-a891-264e5c9fbbb6 }, name: Name("external-dns-a8364658-9f18-48ec-a891-264e5c9fbbb6"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 176, 134])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f8a84a07-b5a5-4df1-b716-350849750307, kind: Service { id: 02376501-3235-4cfe-a1cd-82b53358d277 }, name: Name("external-dns-02376501-3235-4cfe-a1cd-82b53358d277"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 19])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 51cedfa9-394a-4772-9219-c0d1bbd35709, kind: Service { id: d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd }, name: Name("nexus-d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 206, 159])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cc5d4789-938f-4b63-943c-fa25f029e3f9, kind: Service { id: d9ba0639-2706-4be9-a317-acca09a0f0a8 }, name: Name("nexus-d9ba0639-2706-4be9-a317-acca09a0f0a8"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 171])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fbf5a295-1469-4a9e-8440-07b19c913d9a, kind: Service { id: d7179265-27eb-4ac0-b81e-90f9c7b4c49c }, name: Name("nexus-d7179265-27eb-4ac0-b81e-90f9c7b4c49c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 8])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
14442024-10-31T20:31:19.287ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14452024-10-31T20:31:19.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14462024-10-31T20:31:19.289ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14472024-10-31T20:31:19.291ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
14482024-10-31T20:31:19.291ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14492024-10-31T20:31:19.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14502024-10-31T20:31:19.293ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
14512024-10-31T20:31:19.293ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 3f4f0287-3e1d-43e4-92d4-51818f19aeea, kind: Service { id: a8364658-9f18-48ec-a891-264e5c9fbbb6 }, name: Name("external-dns-a8364658-9f18-48ec-a891-264e5c9fbbb6"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 176, 134])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f8a84a07-b5a5-4df1-b716-350849750307, kind: Service { id: 02376501-3235-4cfe-a1cd-82b53358d277 }, name: Name("external-dns-02376501-3235-4cfe-a1cd-82b53358d277"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 19])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 51cedfa9-394a-4772-9219-c0d1bbd35709, kind: Service { id: d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd }, name: Name("nexus-d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 206, 159])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cc5d4789-938f-4b63-943c-fa25f029e3f9, kind: Service { id: d9ba0639-2706-4be9-a317-acca09a0f0a8 }, name: Name("nexus-d9ba0639-2706-4be9-a317-acca09a0f0a8"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 171])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fbf5a295-1469-4a9e-8440-07b19c913d9a, kind: Service { id: d7179265-27eb-4ac0-b81e-90f9c7b4c49c }, name: Name("nexus-d7179265-27eb-4ac0-b81e-90f9c7b4c49c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 8])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
14522024-10-31T20:31:19.293ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
14532024-10-31T20:31:19.338ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "757535d5-39e9-472e-ad2b-09a45236adaa", "date": "Thu, 31 Oct 2024 20:31:18 GMT"} })
14542024-10-31T20:31:19.338ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 switch = Switch0
14552024-10-31T20:31:19.338ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
14562024-10-31T20:31:19.339ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d5aa2b0e-a77e-41d7-9ec3-6978c7fad8de", "content-length": "669", "date": "Thu, 31 Oct 2024 20:31:18 GMT"} })
14572024-10-31T20:31:19.339ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14582024-10-31T20:31:19.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14592024-10-31T20:31:19.343ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14602024-10-31T20:31:19.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14612024-10-31T20:31:19.347ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14622024-10-31T20:31:19.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14632024-10-31T20:31:19.352ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14642024-10-31T20:31:19.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14652024-10-31T20:31:19.361ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 720.668056ms iteration = 21 status = {}
14662024-10-31T20:31:19.420ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 622abb78-eb68-41c1-ac52-e7a263024e57, time_created: 2024-10-31T20:21:08.132037Z, time_modified: 2024-10-31T20:21:08.132037Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: cf9a2d24-88ed-47a2-a402-0cbbba2d1439, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
14672024-10-31T20:31:19.420ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
14682024-10-31T20:31:19.420ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14692024-10-31T20:31:19.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14702024-10-31T20:31:19.423ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
14712024-10-31T20:31:19.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
14722024-10-31T20:31:19.424ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14732024-10-31T20:31:19.431ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 622abb78-eb68-41c1-ac52-e7a263024e57, lookup_type: ById(622abb78-eb68-41c1-ac52-e7a263024e57) } result = Ok(())
14742024-10-31T20:31:19.467ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
14752024-10-31T20:31:19.510ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "ab6d39ce-6ba7-48bc-9912-d7be761a4505", "date": "Thu, 31 Oct 2024 20:31:19 GMT"} })
14762024-10-31T20:31:19.511ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
14772024-10-31T20:31:19.511ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 870.382303ms
14782024-10-31T20:31:19.511ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 870.392963ms iteration = 3 status = {}
14792024-10-31T20:31:19.928ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 4 reason = Timeout
14802024-10-31T20:31:19.928ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
14812024-10-31T20:31:19.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
14822024-10-31T20:31:19.930ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14832024-10-31T20:31:19.932ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
14842024-10-31T20:31:19.932ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
14852024-10-31T20:31:19.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
14862024-10-31T20:31:20.004ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(e6040f2b-57cf-441d-b440-f6892da7484e, 0), (8af0aa37-a1e0-4875-b824-1e0086426039, 0), (72d46137-f450-4b06-a70c-fff0a9560b89, 0), (ad366f59-3a1c-497c-ba14-d678ec1eaf99, 0)] collection_id = e6040f2b-57cf-441d-b440-f6892da7484e
14872024-10-31T20:31:20.004ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
14882024-10-31T20:31:20.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
14892024-10-31T20:31:20.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46541 req_id = 96692138-2471-4d9a-9828-b55acd2c5d40 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
14902024-10-31T20:31:20.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46541 req_id = 96692138-2471-4d9a-9828-b55acd2c5d40 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
14912024-10-31T20:31:20.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3194 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46541 req_id = 96692138-2471-4d9a-9828-b55acd2c5d40 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
14922024-10-31T20:31:20.076ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = e6040f2b-57cf-441d-b440-f6892da7484e file = nexus/db-queries/src/db/datastore/inventory.rs:1446 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 84 nerrors = 0 nnics = 6 nnvme_disk_firmware = 11 nphysical_disks = 11 nrot_pages = 8 nrots = 2 nsled_agent_zones = 1 nsled_agents = 1 nsps = 2 nzones = 28 nzpools = 9
14932024-10-31T20:31:20.076ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
14942024-10-31T20:31:20.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
14952024-10-31T20:31:20.086ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(8af0aa37-a1e0-4875-b824-1e0086426039, 0), (72d46137-f450-4b06-a70c-fff0a9560b89, 0), (ad366f59-3a1c-497c-ba14-d678ec1eaf99, 0), (b91d1d18-f095-4b41-b004-2c81d7d4fce0, 0)] collection_id = 8af0aa37-a1e0-4875-b824-1e0086426039
14962024-10-31T20:31:20.086ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
14972024-10-31T20:31:20.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
14982024-10-31T20:31:20.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = b53714ea-cdbd-4c59-b52f-ddec68d8a1e6 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
14992024-10-31T20:31:20.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = b53714ea-cdbd-4c59-b52f-ddec68d8a1e6 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
15002024-10-31T20:31:20.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2154 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = b53714ea-cdbd-4c59-b52f-ddec68d8a1e6 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
15012024-10-31T20:31:20.166ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 8af0aa37-a1e0-4875-b824-1e0086426039 file = nexus/db-queries/src/db/datastore/inventory.rs:1446 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 84 nerrors = 0 nnics = 6 nnvme_disk_firmware = 11 nphysical_disks = 11 nrot_pages = 8 nrots = 2 nsled_agent_zones = 1 nsled_agents = 1 nsps = 2 nzones = 28 nzpools = 9
15022024-10-31T20:31:20.166ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
15032024-10-31T20:31:20.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
15042024-10-31T20:31:20.177ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(72d46137-f450-4b06-a70c-fff0a9560b89, 0), (ad366f59-3a1c-497c-ba14-d678ec1eaf99, 0), (b91d1d18-f095-4b41-b004-2c81d7d4fce0, 0)]
15052024-10-31T20:31:20.178ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1592, tv_nsec: 835710932 } })
15062024-10-31T20:31:20.209ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
15072024-10-31T20:31:20.209ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
15082024-10-31T20:31:20.209ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
15092024-10-31T20:31:20.210ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "00e159a1-6bf8-4480-b4c7-f312bcab79cc", "content-length": "476", "date": "Thu, 31 Oct 2024 20:31:19 GMT"} })
15102024-10-31T20:31:20.210ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
15112024-10-31T20:31:20.210ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5385d917-2ed7-456c-8dd5-4c3ba7bb82e7", "content-length": "734", "date": "Thu, 31 Oct 2024 20:31:19 GMT"} })
15122024-10-31T20:31:20.210ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
15132024-10-31T20:31:20.210ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8fcb8653-f2f4-4e20-a6e4-685193735e8f", "content-length": "111", "date": "Thu, 31 Oct 2024 20:31:19 GMT"} })
15142024-10-31T20:31:20.210ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
15152024-10-31T20:31:20.211ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e217db0-dca4-42e5-bbe7-80e72209ba93", "content-length": "111", "date": "Thu, 31 Oct 2024 20:31:19 GMT"} })
15162024-10-31T20:31:20.211ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
15172024-10-31T20:31:20.211ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "caa2f651-f5e7-48f4-8870-06f1f1443d60", "content-length": "167", "date": "Thu, 31 Oct 2024 20:31:19 GMT"} })
15182024-10-31T20:31:20.211ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
15192024-10-31T20:31:20.211ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca6be26a-601f-4ecd-9b3c-d6aae937b8cf", "content-length": "167", "date": "Thu, 31 Oct 2024 20:31:19 GMT"} })
15202024-10-31T20:31:20.211ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
15212024-10-31T20:31:20.211ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba8eab35-6017-4966-ba94-25ee82e6307a", "content-length": "175", "date": "Thu, 31 Oct 2024 20:31:19 GMT"} })
15222024-10-31T20:31:20.211ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
15232024-10-31T20:31:20.212ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "34c4118a-1efd-457d-bbe2-98ca7b778001", "content-length": "175", "date": "Thu, 31 Oct 2024 20:31:19 GMT"} })
15242024-10-31T20:31:20.212ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
15252024-10-31T20:31:20.212ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "4f0c5fac-a73d-4cdb-b2e7-150560bdff3b", "content-length": "702", "date": "Thu, 31 Oct 2024 20:31:19 GMT"} })
15262024-10-31T20:31:20.212ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
15272024-10-31T20:31:20.212ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d9975613-865f-47c9-90de-78542438e9e2", "content-length": "727", "date": "Thu, 31 Oct 2024 20:31:19 GMT"} })
15282024-10-31T20:31:20.212ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
15292024-10-31T20:31:20.212ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf10af8e-7ab2-46ce-81f3-66078b6ba78d", "content-length": "729", "date": "Thu, 31 Oct 2024 20:31:19 GMT"} })
15302024-10-31T20:31:20.212ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
15312024-10-31T20:31:20.212ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "baf7e3b8-c415-49a2-af34-475c23eddb2e", "content-length": "728", "date": "Thu, 31 Oct 2024 20:31:19 GMT"} })
15322024-10-31T20:31:20.212ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
15332024-10-31T20:31:20.212ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "bdec6c2b-9e77-4779-aa03-9f2a96d01a04", "content-length": "722", "date": "Thu, 31 Oct 2024 20:31:19 GMT"} })
15342024-10-31T20:31:20.212ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
15352024-10-31T20:31:20.213ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "78c7b6c8-11b4-47b1-b3e1-f006dc1c93bd", "content-length": "109", "date": "Thu, 31 Oct 2024 20:31:19 GMT"} })
15362024-10-31T20:31:20.213ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
15372024-10-31T20:31:20.213ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "395e2e4e-cbda-41d1-ad86-201d2321a4f7", "content-length": "109", "date": "Thu, 31 Oct 2024 20:31:19 GMT"} })
15382024-10-31T20:31:20.213ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
15392024-10-31T20:31:20.213ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9874af1e-af98-491f-9aa1-dd90cb63457b", "content-length": "169", "date": "Thu, 31 Oct 2024 20:31:19 GMT"} })
15402024-10-31T20:31:20.213ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
15412024-10-31T20:31:20.213ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d37448f-15d6-4b67-bdcb-348841be7b6e", "content-length": "169", "date": "Thu, 31 Oct 2024 20:31:19 GMT"} })
15422024-10-31T20:31:20.213ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
15432024-10-31T20:31:20.214ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "49d1778a-1402-4920-8c88-6d15b1786aaa", "content-length": "178", "date": "Thu, 31 Oct 2024 20:31:19 GMT"} })
15442024-10-31T20:31:20.214ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
15452024-10-31T20:31:20.214ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1e12f393-a161-4aa0-b0d4-3421cdb0ee79", "content-length": "178", "date": "Thu, 31 Oct 2024 20:31:19 GMT"} })
15462024-10-31T20:31:20.214ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
15472024-10-31T20:31:20.214ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7b0b5b12-d7f8-4533-9cd6-4a0be3f71547", "content-length": "702", "date": "Thu, 31 Oct 2024 20:31:19 GMT"} })
15482024-10-31T20:31:20.214ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
15492024-10-31T20:31:20.214ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0cbf1d15-0ebf-4e35-93cb-a5613657e2ac", "content-length": "727", "date": "Thu, 31 Oct 2024 20:31:19 GMT"} })
15502024-10-31T20:31:20.214ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
15512024-10-31T20:31:20.214ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f6ebda3d-bfa9-47d0-b49e-98ad494c7d66", "content-length": "729", "date": "Thu, 31 Oct 2024 20:31:19 GMT"} })
15522024-10-31T20:31:20.214ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
15532024-10-31T20:31:20.214ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "71810d6b-3756-4c3e-aae4-6dab948fe74d", "content-length": "728", "date": "Thu, 31 Oct 2024 20:31:19 GMT"} })
15542024-10-31T20:31:20.214ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
15552024-10-31T20:31:20.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
15562024-10-31T20:31:20.216ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15572024-10-31T20:31:20.218ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
15582024-10-31T20:31:20.218ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
15592024-10-31T20:31:20.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
15602024-10-31T20:31:20.220ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15612024-10-31T20:31:20.221ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
15622024-10-31T20:31:20.221ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
15632024-10-31T20:31:20.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
15642024-10-31T20:31:20.303ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
15652024-10-31T20:31:20.303ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
15662024-10-31T20:31:20.509ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "abd25844-9d0f-4871-8883-bc06fbca8871", "content-length": "29195", "date": "Thu, 31 Oct 2024 20:31:19 GMT"} })
15672024-10-31T20:31:20.511ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
15682024-10-31T20:31:20.513ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
15692024-10-31T20:31:20.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
15702024-10-31T20:31:20.515ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15712024-10-31T20:31:20.517ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
15722024-10-31T20:31:20.517ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
15732024-10-31T20:31:20.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
15742024-10-31T20:31:20.684ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 667cc8f4-6610-43a7-96bb-dc69c05ae87e file = nexus/db-queries/src/db/datastore/inventory.rs:1000
15752024-10-31T20:31:20.684ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 667cc8f4-6610-43a7-96bb-dc69c05ae87e time_started = 2024-10-31 20:31:20.209788 UTC
15762024-10-31T20:31:20.684ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 756.095138ms iteration = 4 status = {"collection_id":"667cc8f4-6610-43a7-96bb-dc69c05ae87e","time_done":"2024-10-31 20:31:20.511590 UTC","time_started":"2024-10-31 20:31:20.209788 UTC"}
15772024-10-31T20:31:20.684ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Dependency
15782024-10-31T20:31:20.684ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15792024-10-31T20:31:20.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15802024-10-31T20:31:20.686ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15812024-10-31T20:31:20.688ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15822024-10-31T20:31:20.688ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15832024-10-31T20:31:20.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15842024-10-31T20:31:20.691ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15852024-10-31T20:31:20.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15862024-10-31T20:31:20.692ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15872024-10-31T20:31:20.694ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15882024-10-31T20:31:20.694ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15892024-10-31T20:31:20.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15902024-10-31T20:31:20.787ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 102.737383ms iteration = 25 status = {"physical_disks_added":0}
15912024-10-31T20:31:21.184ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 322778d8-8f3f-4c63-b3fd-f5914120d765 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
15922024-10-31T20:31:21.184ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 322778d8-8f3f-4c63-b3fd-f5914120d765 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
15932024-10-31T20:31:21.186ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2574 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 322778d8-8f3f-4c63-b3fd-f5914120d765 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
15942024-10-31T20:31:22.208ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 4ac0eaa5-0419-431e-b804-e771785cfcbd roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
15952024-10-31T20:31:22.208ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 4ac0eaa5-0419-431e-b804-e771785cfcbd resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
15962024-10-31T20:31:22.210ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2296 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 4ac0eaa5-0419-431e-b804-e771785cfcbd response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
15972024-10-31T20:31:22.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = a1083467-dfaf-4def-ac1e-1824b7509e46 roles = RoleSet { roles: {} } uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?sort_by=id_ascending
15982024-10-31T20:31:22.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = a1083467-dfaf-4def-ac1e-1824b7509e46 resource = Database result = Ok(()) uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?sort_by=id_ascending
15992024-10-31T20:31:22.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2895 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = a1083467-dfaf-4def-ac1e-1824b7509e46 response_code = 200 uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?sort_by=id_ascending
16002024-10-31T20:31:22.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = 03cf1f2a-0ce4-4786-b8bb-5d2aa75c7def roles = RoleSet { roles: {} } uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzA4NDI3Ny1iNmFhLTQ1OWYtOGY4MS1mNGVmNGM3Yzg0M2UifX0%3D
16012024-10-31T20:31:22.819ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = 03cf1f2a-0ce4-4786-b8bb-5d2aa75c7def resource = Database result = Ok(()) uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzA4NDI3Ny1iNmFhLTQ1OWYtOGY4MS1mNGVmNGM3Yzg0M2UifX0%3D
16022024-10-31T20:31:22.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2701 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = 03cf1f2a-0ce4-4786-b8bb-5d2aa75c7def response_code = 200 uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzA4NDI3Ny1iNmFhLTQ1OWYtOGY4MS1mNGVmNGM3Yzg0M2UifX0%3D
16032024-10-31T20:31:23.231ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 98801a0d-1806-4821-a280-d673a573bfb7 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
16042024-10-31T20:31:23.232ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 98801a0d-1806-4821-a280-d673a573bfb7 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
16052024-10-31T20:31:23.233ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2124 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 98801a0d-1806-4821-a280-d673a573bfb7 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
16062024-10-31T20:31:24.105ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
16072024-10-31T20:31:24.105ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
16082024-10-31T20:31:24.136ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
16092024-10-31T20:31:24.136ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:64732
16102024-10-31T20:31:24.136ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:64732 req_id = 60dba1fc-21e9-4166-aa23-c8b28e9d53ac roles = RoleSet { roles: {} } uri = /metrics/producers
16112024-10-31T20:31:24.136ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:64732 req_id = 60dba1fc-21e9-4166-aa23-c8b28e9d53ac resource = Database result = Ok(()) uri = /metrics/producers
16122024-10-31T20:31:24.147ZINFOnexus: assigned collector to new producer collector_id = 6e71f19b-440f-4a40-bbbb-fa1de5a7e58c file = nexus/src/app/oximeter.rs:76 producer_id = d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
16132024-10-31T20:31:24.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 10998 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:64732 req_id = 60dba1fc-21e9-4166-aa23-c8b28e9d53ac response_code = 201 uri = /metrics/producers
16142024-10-31T20:31:24.147ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "60dba1fc-21e9-4166-aa23-c8b28e9d53ac", "content-length": "41", "date": "Thu, 31 Oct 2024 20:31:24 GMT"} })
16152024-10-31T20:31:24.148ZDEBGnexus (producer-registration-task): registered with nexus successfully
16162024-10-31T20:31:24.148ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
16172024-10-31T20:31:24.254ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 2ea0c290-043b-44f8-b3b2-fd976ce50fdc roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
16182024-10-31T20:31:24.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 2ea0c290-043b-44f8-b3b2-fd976ce50fdc resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
16192024-10-31T20:31:24.256ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2437 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 2ea0c290-043b-44f8-b3b2-fd976ce50fdc response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
16202024-10-31T20:31:25.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 08ac381a-7020-4214-82a5-9fec7441fff1 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
16212024-10-31T20:31:25.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 08ac381a-7020-4214-82a5-9fec7441fff1 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
16222024-10-31T20:31:25.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1947 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 08ac381a-7020-4214-82a5-9fec7441fff1 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
16232024-10-31T20:31:26.301ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 36dcf9fc-71e7-48ab-b240-897c76e16d28 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
16242024-10-31T20:31:26.302ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 36dcf9fc-71e7-48ab-b240-897c76e16d28 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
16252024-10-31T20:31:26.304ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2756 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 36dcf9fc-71e7-48ab-b240-897c76e16d28 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
16262024-10-31T20:31:27.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = fcf29ed9-8082-49c8-ad65-0319b9933cc6 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
16272024-10-31T20:31:27.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = fcf29ed9-8082-49c8-ad65-0319b9933cc6 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
16282024-10-31T20:31:27.327ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2145 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = fcf29ed9-8082-49c8-ad65-0319b9933cc6 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
16292024-10-31T20:31:28.348ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 707af5f9-a235-46ed-9ae7-20c91568e769 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
16302024-10-31T20:31:28.348ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 707af5f9-a235-46ed-9ae7-20c91568e769 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
16312024-10-31T20:31:28.350ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1932 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 707af5f9-a235-46ed-9ae7-20c91568e769 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
16322024-10-31T20:31:28.640ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
16332024-10-31T20:31:28.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16342024-10-31T20:31:28.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16352024-10-31T20:31:28.641ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
16362024-10-31T20:31:28.641ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16372024-10-31T20:31:28.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16382024-10-31T20:31:28.642ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16392024-10-31T20:31:28.644ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
16402024-10-31T20:31:28.644ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16412024-10-31T20:31:28.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16422024-10-31T20:31:28.646ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16432024-10-31T20:31:28.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16442024-10-31T20:31:28.651ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16452024-10-31T20:31:28.653ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 56b527e7-66b3-4602-a305-5dc763e7fb8b, lookup_type: ById(56b527e7-66b3-4602-a305-5dc763e7fb8b) } result = Ok(())
16462024-10-31T20:31:28.653ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16472024-10-31T20:31:28.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16482024-10-31T20:31:28.666ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b original_time_created = 2024-10-31 20:20:56.758465 UTC target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b time_created = 2024-10-31 20:20:56.758465 UTC
16492024-10-31T20:31:28.666ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.301401ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"56b527e7-66b3-4602-a305-5dc763e7fb8b","time_created":"2024-10-31T20:20:56.758465Z"}
16502024-10-31T20:31:28.674ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16512024-10-31T20:31:28.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16522024-10-31T20:31:28.703ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.08813ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
16532024-10-31T20:31:29.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 9c4b688d-5122-495a-8a9f-43abe992f017 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
16542024-10-31T20:31:29.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 9c4b688d-5122-495a-8a9f-43abe992f017 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
16552024-10-31T20:31:29.372ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2526 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 9c4b688d-5122-495a-8a9f-43abe992f017 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
16562024-10-31T20:31:29.632ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:58895
16572024-10-31T20:31:29.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58895 req_id = 05cbf160-8029-4099-aca7-d5db34c1814a roles = RoleSet { roles: {} } uri = /metrics/producers
16582024-10-31T20:31:29.632ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58895 req_id = 05cbf160-8029-4099-aca7-d5db34c1814a resource = Database result = Ok(()) uri = /metrics/producers
16592024-10-31T20:31:29.677ZINFOnexus: assigned collector to new producer collector_id = 6e71f19b-440f-4a40-bbbb-fa1de5a7e58c file = nexus/src/app/oximeter.rs:76 producer_id = 443ed735-d897-4113-ac28-5f8cde119db0
16602024-10-31T20:31:29.677ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 44726 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58895 req_id = 05cbf160-8029-4099-aca7-d5db34c1814a response_code = 201 uri = /metrics/producers
16612024-10-31T20:31:30.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 59111c0d-0adb-4842-a213-c94f49c22b11 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
16622024-10-31T20:31:30.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 59111c0d-0adb-4842-a213-c94f49c22b11 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
16632024-10-31T20:31:30.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1654 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 59111c0d-0adb-4842-a213-c94f49c22b11 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
16642024-10-31T20:31:31.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 3b35a4ac-9338-4b98-9598-d1ec780f05fd roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
16652024-10-31T20:31:31.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 3b35a4ac-9338-4b98-9598-d1ec780f05fd resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
16662024-10-31T20:31:31.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2421 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 3b35a4ac-9338-4b98-9598-d1ec780f05fd response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
16672024-10-31T20:31:32.438ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 96f4f0c7-aafb-4e23-bc60-16b263786ebf roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
16682024-10-31T20:31:32.438ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 96f4f0c7-aafb-4e23-bc60-16b263786ebf resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
16692024-10-31T20:31:32.440ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1998 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 96f4f0c7-aafb-4e23-bc60-16b263786ebf response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
16702024-10-31T20:31:32.824ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1343 local_addr = [fd00:1122:3344:101::c]:63183 method = GET remote_addr = [fd00:1122:3344:101::d]:38560 req_id = 6c0a5325-27a3-46d2-9a9c-b56cd3258f86 response_code = 200 uri = /d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
16712024-10-31T20:31:33.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 3e997ac6-b646-4a1c-baf3-e85e7eba8918 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
16722024-10-31T20:31:33.463ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 3e997ac6-b646-4a1c-baf3-e85e7eba8918 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
16732024-10-31T20:31:33.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2126 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 3e997ac6-b646-4a1c-baf3-e85e7eba8918 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
16742024-10-31T20:31:34.486ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 2e0ba21e-3820-49ee-9477-2b7f893a0095 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
16752024-10-31T20:31:34.486ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 2e0ba21e-3820-49ee-9477-2b7f893a0095 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
16762024-10-31T20:31:34.488ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2234 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 2e0ba21e-3820-49ee-9477-2b7f893a0095 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
16772024-10-31T20:31:35.509ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = e71b3675-8b09-4654-b038-cb9429fd26d5 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
16782024-10-31T20:31:35.510ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = e71b3675-8b09-4654-b038-cb9429fd26d5 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
16792024-10-31T20:31:35.511ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2058 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = e71b3675-8b09-4654-b038-cb9429fd26d5 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
16802024-10-31T20:31:36.531ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = d67a217b-cc39-4d5c-95dd-7bb44f770fff roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
16812024-10-31T20:31:36.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = d67a217b-cc39-4d5c-95dd-7bb44f770fff resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
16822024-10-31T20:31:36.533ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2073 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = d67a217b-cc39-4d5c-95dd-7bb44f770fff response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
16832024-10-31T20:31:36.734ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:52706
16842024-10-31T20:31:36.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52706 req_id = 58506b45-ea22-4fc2-ad1a-7d88e4b46235 roles = RoleSet { roles: {} } uri = /metrics/producers
16852024-10-31T20:31:36.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52706 req_id = 58506b45-ea22-4fc2-ad1a-7d88e4b46235 resource = Database result = Ok(()) uri = /metrics/producers
16862024-10-31T20:31:36.772ZINFOnexus: assigned collector to new producer collector_id = 6e71f19b-440f-4a40-bbbb-fa1de5a7e58c file = nexus/src/app/oximeter.rs:76 producer_id = 622abb78-eb68-41c1-ac52-e7a263024e57
16872024-10-31T20:31:36.772ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 37726 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52706 req_id = 58506b45-ea22-4fc2-ad1a-7d88e4b46235 response_code = 201 uri = /metrics/producers
16882024-10-31T20:31:37.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 1c682520-e064-4cd9-83e8-15f16b15aea8 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
16892024-10-31T20:31:37.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 1c682520-e064-4cd9-83e8-15f16b15aea8 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
16902024-10-31T20:31:37.557ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2273 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 1c682520-e064-4cd9-83e8-15f16b15aea8 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
16912024-10-31T20:31:38.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 2535c054-512e-42c9-8737-aec1d7192dcf roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
16922024-10-31T20:31:38.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 2535c054-512e-42c9-8737-aec1d7192dcf resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
16932024-10-31T20:31:38.581ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2543 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 2535c054-512e-42c9-8737-aec1d7192dcf response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
16942024-10-31T20:31:38.640ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
16952024-10-31T20:31:38.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16962024-10-31T20:31:38.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16972024-10-31T20:31:38.641ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
16982024-10-31T20:31:38.641ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16992024-10-31T20:31:38.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17002024-10-31T20:31:38.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17012024-10-31T20:31:38.647ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17022024-10-31T20:31:38.647ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17032024-10-31T20:31:38.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17042024-10-31T20:31:38.650ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17052024-10-31T20:31:38.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17062024-10-31T20:31:38.652ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17072024-10-31T20:31:38.656ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 56b527e7-66b3-4602-a305-5dc763e7fb8b, lookup_type: ById(56b527e7-66b3-4602-a305-5dc763e7fb8b) } result = Ok(())
17082024-10-31T20:31:38.656ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17092024-10-31T20:31:38.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17102024-10-31T20:31:38.672ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b original_time_created = 2024-10-31 20:20:56.758465 UTC target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b time_created = 2024-10-31 20:20:56.758465 UTC
17112024-10-31T20:31:38.672ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 32.099404ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"56b527e7-66b3-4602-a305-5dc763e7fb8b","time_created":"2024-10-31T20:20:56.758465Z"}
17122024-10-31T20:31:38.686ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17132024-10-31T20:31:38.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17142024-10-31T20:31:38.727ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 86.61433ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17152024-10-31T20:31:39.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = cef4cd47-418c-4b56-9ec8-5c3517ae268e roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
17162024-10-31T20:31:39.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = cef4cd47-418c-4b56-9ec8-5c3517ae268e resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
17172024-10-31T20:31:39.604ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2668 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = cef4cd47-418c-4b56-9ec8-5c3517ae268e response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
17182024-10-31T20:31:40.626ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 348eadcc-557a-452c-81c7-d1f3e89e2a8c roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
17192024-10-31T20:31:40.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 348eadcc-557a-452c-81c7-d1f3e89e2a8c resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
17202024-10-31T20:31:40.628ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2050 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 348eadcc-557a-452c-81c7-d1f3e89e2a8c response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
17212024-10-31T20:31:41.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 19eb5f0d-9e60-4ed1-94d8-271e2f23c2c3 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
17222024-10-31T20:31:41.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 19eb5f0d-9e60-4ed1-94d8-271e2f23c2c3 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
17232024-10-31T20:31:41.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2715 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 19eb5f0d-9e60-4ed1-94d8-271e2f23c2c3 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
17242024-10-31T20:31:42.672ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 2cc75966-7080-44c6-83ca-3bad1e804b0d roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
17252024-10-31T20:31:42.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 2cc75966-7080-44c6-83ca-3bad1e804b0d resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
17262024-10-31T20:31:42.675ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2409 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 2cc75966-7080-44c6-83ca-3bad1e804b0d response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
17272024-10-31T20:31:43.697ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 1c97588d-6a29-40d2-a444-e419e4e540da roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
17282024-10-31T20:31:43.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 1c97588d-6a29-40d2-a444-e419e4e540da resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
17292024-10-31T20:31:43.699ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1750 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 1c97588d-6a29-40d2-a444-e419e4e540da response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
17302024-10-31T20:31:44.720ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 1385e939-76e8-4af9-9e76-908ec7781383 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
17312024-10-31T20:31:44.721ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 1385e939-76e8-4af9-9e76-908ec7781383 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
17322024-10-31T20:31:44.722ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2084 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 1385e939-76e8-4af9-9e76-908ec7781383 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
17332024-10-31T20:31:45.743ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = cd9a3e81-9af4-45ac-91d7-79639c81b013 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
17342024-10-31T20:31:45.744ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = cd9a3e81-9af4-45ac-91d7-79639c81b013 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
17352024-10-31T20:31:45.745ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1979 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = cd9a3e81-9af4-45ac-91d7-79639c81b013 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
17362024-10-31T20:31:46.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 9f2781b4-ae50-467a-bbf3-d2db3d2147e3 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
17372024-10-31T20:31:46.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 9f2781b4-ae50-467a-bbf3-d2db3d2147e3 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
17382024-10-31T20:31:46.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2323 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 9f2781b4-ae50-467a-bbf3-d2db3d2147e3 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
17392024-10-31T20:31:47.791ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = ca9bf143-976f-4a60-996b-6c4599ac5e87 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
17402024-10-31T20:31:47.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = ca9bf143-976f-4a60-996b-6c4599ac5e87 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
17412024-10-31T20:31:47.793ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2232 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = ca9bf143-976f-4a60-996b-6c4599ac5e87 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
17422024-10-31T20:31:47.822ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1388 local_addr = [fd00:1122:3344:101::c]:63183 method = GET remote_addr = [fd00:1122:3344:101::d]:38560 req_id = cdfc9f87-05e8-4a01-be3a-97dcd2307f14 response_code = 200 uri = /d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
17432024-10-31T20:31:48.640ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
17442024-10-31T20:31:48.640ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17452024-10-31T20:31:48.641ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
17462024-10-31T20:31:48.641ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
17472024-10-31T20:31:48.641ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17482024-10-31T20:31:48.641ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
17492024-10-31T20:31:48.641ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
17502024-10-31T20:31:48.641ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
17512024-10-31T20:31:48.641ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
17522024-10-31T20:31:48.641ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
17532024-10-31T20:31:48.641ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
17542024-10-31T20:31:48.641ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17552024-10-31T20:31:48.641ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
17562024-10-31T20:31:48.641ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
17572024-10-31T20:31:48.641ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
17582024-10-31T20:31:48.641ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17592024-10-31T20:31:48.641ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17602024-10-31T20:31:48.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17612024-10-31T20:31:48.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
17622024-10-31T20:31:48.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
17632024-10-31T20:31:48.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17642024-10-31T20:31:48.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17652024-10-31T20:31:48.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
17662024-10-31T20:31:48.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17672024-10-31T20:31:48.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17682024-10-31T20:31:48.642ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
17692024-10-31T20:31:48.642ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
17702024-10-31T20:31:48.642ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 11.91\u{b5}s iteration = 22 status = {"errors":[],"records_set_to_done":[]}
17712024-10-31T20:31:48.642ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
17722024-10-31T20:31:48.642ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 6.4\u{b5}s iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
17732024-10-31T20:31:48.642ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
17742024-10-31T20:31:48.642ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 6.64\u{b5}s iteration = 22 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
17752024-10-31T20:31:48.642ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
17762024-10-31T20:31:48.642ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 3.16\u{b5}s iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
17772024-10-31T20:31:48.642ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
17782024-10-31T20:31:48.642ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
17792024-10-31T20:31:48.642ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
17802024-10-31T20:31:48.642ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
17812024-10-31T20:31:48.642ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17822024-10-31T20:31:48.642ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
17832024-10-31T20:31:48.642ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
17842024-10-31T20:31:48.642ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17852024-10-31T20:31:48.642ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17862024-10-31T20:31:48.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
17872024-10-31T20:31:48.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17882024-10-31T20:31:48.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
17892024-10-31T20:31:48.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17902024-10-31T20:31:48.643ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17912024-10-31T20:31:48.644ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.084494ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
17922024-10-31T20:31:48.644ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1621, tv_nsec: 301289477 } })
17932024-10-31T20:31:48.644ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
17942024-10-31T20:31:48.644ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17952024-10-31T20:31:48.645ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
17962024-10-31T20:31:48.645ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17972024-10-31T20:31:48.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17982024-10-31T20:31:48.647ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1621, tv_nsec: 304870760 } })
17992024-10-31T20:31:48.647ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
18002024-10-31T20:31:48.648ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18012024-10-31T20:31:48.648ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18022024-10-31T20:31:48.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18032024-10-31T20:31:48.651ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18042024-10-31T20:31:48.651ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18052024-10-31T20:31:48.652ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18062024-10-31T20:31:48.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18072024-10-31T20:31:48.653ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
18082024-10-31T20:31:48.653ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18092024-10-31T20:31:48.653ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1621, tv_nsec: 310790074 } })
18102024-10-31T20:31:48.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18112024-10-31T20:31:48.653ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
18122024-10-31T20:31:48.653ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
18132024-10-31T20:31:48.653ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439
18142024-10-31T20:31:48.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
18152024-10-31T20:31:48.655ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18162024-10-31T20:31:48.657ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 56b527e7-66b3-4602-a305-5dc763e7fb8b, lookup_type: ById(56b527e7-66b3-4602-a305-5dc763e7fb8b) } result = Ok(())
18172024-10-31T20:31:48.657ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18182024-10-31T20:31:48.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18192024-10-31T20:31:48.672ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18202024-10-31T20:31:48.674ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18212024-10-31T20:31:48.675ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b original_time_created = 2024-10-31 20:20:56.758465 UTC target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b time_created = 2024-10-31 20:20:56.758465 UTC
18222024-10-31T20:31:48.675ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 34.79957ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"56b527e7-66b3-4602-a305-5dc763e7fb8b","time_created":"2024-10-31T20:20:56.758465Z"}
18232024-10-31T20:31:48.676ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
18242024-10-31T20:31:48.676ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18252024-10-31T20:31:48.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18262024-10-31T20:31:48.677ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
18272024-10-31T20:31:48.677ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18282024-10-31T20:31:48.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18292024-10-31T20:31:48.679ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18302024-10-31T20:31:48.679ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18312024-10-31T20:31:48.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18322024-10-31T20:31:48.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18332024-10-31T20:31:48.680ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18342024-10-31T20:31:48.681ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
18352024-10-31T20:31:48.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
18362024-10-31T20:31:48.682ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
18372024-10-31T20:31:48.682ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18382024-10-31T20:31:48.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18392024-10-31T20:31:48.690ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18402024-10-31T20:31:48.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18412024-10-31T20:31:48.691ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18422024-10-31T20:31:48.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18432024-10-31T20:31:48.692ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 50.340253ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18442024-10-31T20:31:48.694ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
18452024-10-31T20:31:48.694ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
18462024-10-31T20:31:48.694ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18472024-10-31T20:31:48.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18482024-10-31T20:31:48.696ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18492024-10-31T20:31:48.699ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
18502024-10-31T20:31:48.699ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18512024-10-31T20:31:48.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18522024-10-31T20:31:48.705ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
18532024-10-31T20:31:48.705ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 63.674008ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
18542024-10-31T20:31:48.707ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18552024-10-31T20:31:48.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18562024-10-31T20:31:48.713ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
18572024-10-31T20:31:48.713ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
18582024-10-31T20:31:48.714ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "89c8cddb-0e36-46b3-bbdb-d9ee1f26a2f2", "content-length": "26", "date": "Thu, 31 Oct 2024 20:31:48 GMT"} })
18592024-10-31T20:31:48.714ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
18602024-10-31T20:31:48.716ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
18612024-10-31T20:31:48.719ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 78.65631ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
18622024-10-31T20:31:48.724ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
18632024-10-31T20:31:48.724ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
18642024-10-31T20:31:48.724ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "37838f2b-faad-4993-9f2a-00618ac6cb8a", "content-length": "26", "date": "Thu, 31 Oct 2024 20:31:48 GMT"} })
18652024-10-31T20:31:48.724ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
18662024-10-31T20:31:48.726ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
18672024-10-31T20:31:48.726ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
18682024-10-31T20:31:48.726ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18692024-10-31T20:31:48.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18702024-10-31T20:31:48.726ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
18712024-10-31T20:31:48.738ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 zone_address = fd00:1122:3344:101::2
18722024-10-31T20:31:48.738ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
18732024-10-31T20:31:48.738ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a46d1fa1-40f4-460c-b004-f6b52bf948b3", "content-length": "26", "date": "Thu, 31 Oct 2024 20:31:48 GMT"} })
18742024-10-31T20:31:48.738ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
18752024-10-31T20:31:48.741ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439
18762024-10-31T20:31:48.784ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 143.403396ms iteration = 26 status = {"physical_disks_added":0}
18772024-10-31T20:31:48.785ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18782024-10-31T20:31:48.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18792024-10-31T20:31:48.805ZINFOnexus (BackgroundTasks): VPC route manager sled 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
18802024-10-31T20:31:48.805ZDEBGnexus (BackgroundTasks): client request SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
18812024-10-31T20:31:48.805ZDEBGnexus (BackgroundTasks): client response SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "947544a0-e54d-4b8b-ba83-f5e683cc5d8b", "content-length": "372", "date": "Thu, 31 Oct 2024 20:31:48 GMT"} })
18822024-10-31T20:31:48.805ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18832024-10-31T20:31:48.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18842024-10-31T20:31:48.807ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18852024-10-31T20:31:48.807ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18862024-10-31T20:31:48.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18872024-10-31T20:31:48.808ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18882024-10-31T20:31:48.809ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
18892024-10-31T20:31:48.809ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18902024-10-31T20:31:48.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18912024-10-31T20:31:48.813ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18922024-10-31T20:31:48.814ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 927e9efb-ed66-4fb8-969d-064ff3c7f04e roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
18932024-10-31T20:31:48.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 927e9efb-ed66-4fb8-969d-064ff3c7f04e resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
18942024-10-31T20:31:48.816ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
18952024-10-31T20:31:48.816ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18962024-10-31T20:31:48.816ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 622abb78-eb68-41c1-ac52-e7a263024e57, lookup_type: ById(622abb78-eb68-41c1-ac52-e7a263024e57) } result = Ok(())
18972024-10-31T20:31:48.816ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18982024-10-31T20:31:48.816ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1646 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 927e9efb-ed66-4fb8-969d-064ff3c7f04e response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
18992024-10-31T20:31:48.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19002024-10-31T20:31:48.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19012024-10-31T20:31:48.818ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 177.302411ms iteration = 22 status = 0
19022024-10-31T20:31:48.824ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
19032024-10-31T20:31:48.824ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc7b632f-3494-4ea3-9f13-4efa4034b9c9", "content-length": "1", "date": "Thu, 31 Oct 2024 20:31:47 GMT"} })
19042024-10-31T20:31:48.826ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
19052024-10-31T20:31:48.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
19062024-10-31T20:31:48.828ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 187.695484ms iteration = 22 status = null
19072024-10-31T20:31:48.837ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 196.686191ms iteration = 22 status = {}
19082024-10-31T20:31:48.842ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19092024-10-31T20:31:48.842ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
19102024-10-31T20:31:48.842ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 199.942629ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
19112024-10-31T20:31:48.859ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
19122024-10-31T20:31:48.859ZDEBGnexus (BackgroundTasks): client request SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
19132024-10-31T20:31:48.859ZDEBGnexus (BackgroundTasks): client response SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "cd1b0f71-0bcc-4d49-b3db-15d814ed571d", "date": "Thu, 31 Oct 2024 20:31:48 GMT"} })
19142024-10-31T20:31:48.860ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19152024-10-31T20:31:48.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19162024-10-31T20:31:48.862ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19172024-10-31T20:31:48.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19182024-10-31T20:31:48.868ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19192024-10-31T20:31:48.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19202024-10-31T20:31:48.871ZINFOnexus (BackgroundTasks): VPC route manager sled 622abb78-eb68-41c1-ac52-e7a263024e57 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
19212024-10-31T20:31:48.871ZDEBGnexus (BackgroundTasks): client request SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
19222024-10-31T20:31:48.872ZDEBGnexus (BackgroundTasks): client response SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "16054f11-8894-4336-8fab-b52f1b50c356", "date": "Thu, 31 Oct 2024 20:31:48 GMT"} })
19232024-10-31T20:31:48.873ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 231.659014ms iteration = 23 status = {}
19242024-10-31T20:31:48.915ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19252024-10-31T20:31:48.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19262024-10-31T20:31:48.933ZDEBGnexus (BackgroundTasks): client request SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
19272024-10-31T20:31:48.933ZDEBGnexus (BackgroundTasks): client response SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d30f4db-55ad-4e68-af31-c63f3899e8f0", "content-length": "691", "date": "Thu, 31 Oct 2024 20:31:48 GMT"} })
19282024-10-31T20:31:48.933ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
19292024-10-31T20:31:48.933ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
19302024-10-31T20:31:48.933ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
19312024-10-31T20:31:48.935ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2c0ce4ae-e332-4e80-bd64-c2d6cfd99f8f, rack_id: cf9a2d24-88ed-47a2-a402-0cbbba2d1439, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(1479dccf-28ea-4cc0-9964-818390bddf17) } rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 switch_location = Switch0
19322024-10-31T20:31:48.935ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19332024-10-31T20:31:48.935ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 294.576209ms iteration = 22 status = {}
19342024-10-31T20:31:48.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19352024-10-31T20:31:48.944ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
19362024-10-31T20:31:48.944ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "bae18aa0-188e-4a5e-add6-ef588e248eae", "content-length": "121", "date": "Thu, 31 Oct 2024 20:31:48 GMT"} })
19372024-10-31T20:31:48.944ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
19382024-10-31T20:31:48.944ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 1479dccf-28ea-4cc0-9964-818390bddf17
19392024-10-31T20:31:48.945ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
19402024-10-31T20:31:48.945ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
19412024-10-31T20:31:48.945ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
19422024-10-31T20:31:48.945ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
19432024-10-31T20:31:48.945ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
19442024-10-31T20:31:48.945ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
19452024-10-31T20:31:48.945ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
19462024-10-31T20:31:48.945ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
19472024-10-31T20:31:48.945ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439
19482024-10-31T20:31:48.945ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19492024-10-31T20:31:48.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19502024-10-31T20:31:48.947ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
19512024-10-31T20:31:48.947ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "42d238ce-e11c-45af-8a69-e1c6f88211ed", "content-length": "2", "date": "Thu, 31 Oct 2024 20:31:48 GMT"} })
19522024-10-31T20:31:48.947ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
19532024-10-31T20:31:48.947ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "96ae4d88-adcd-44b8-b012-a2ff64871d30", "content-length": "52", "date": "Thu, 31 Oct 2024 20:31:48 GMT"} })
19542024-10-31T20:31:48.947ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 switch_location = Switch0
19552024-10-31T20:31:48.947ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
19562024-10-31T20:31:49.064ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "c8e9bf59-9ffc-480c-a2fe-6d192acbd94b", "date": "Thu, 31 Oct 2024 20:31:48 GMT"} })
19572024-10-31T20:31:49.064ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 switch = Switch0
19582024-10-31T20:31:49.064ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
19592024-10-31T20:31:49.065ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e607f79d-6727-41e1-b1e3-854af4a37758", "content-length": "669", "date": "Thu, 31 Oct 2024 20:31:48 GMT"} })
19602024-10-31T20:31:49.065ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19612024-10-31T20:31:49.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19622024-10-31T20:31:49.068ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19632024-10-31T20:31:49.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19642024-10-31T20:31:49.072ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19652024-10-31T20:31:49.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19662024-10-31T20:31:49.074ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19672024-10-31T20:31:49.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19682024-10-31T20:31:49.086ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 445.232023ms iteration = 22 status = {}
19692024-10-31T20:31:49.839ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 146368fb-9076-4153-aeba-179a5c576e23 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
19702024-10-31T20:31:49.839ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 146368fb-9076-4153-aeba-179a5c576e23 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
19712024-10-31T20:31:49.841ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2159 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 146368fb-9076-4153-aeba-179a5c576e23 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
19722024-10-31T20:31:50.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46541 req_id = c38d641d-d27c-48f4-a8c8-4e8c3742dd97 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
19732024-10-31T20:31:50.104ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46541 req_id = c38d641d-d27c-48f4-a8c8-4e8c3742dd97 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
19742024-10-31T20:31:50.107ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3673 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46541 req_id = c38d641d-d27c-48f4-a8c8-4e8c3742dd97 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
19752024-10-31T20:31:50.862ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 9168c58b-1c1e-4b89-8b15-9128abb9451e roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
19762024-10-31T20:31:50.862ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 9168c58b-1c1e-4b89-8b15-9128abb9451e resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
19772024-10-31T20:31:50.864ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2401 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 9168c58b-1c1e-4b89-8b15-9128abb9451e response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
19782024-10-31T20:31:51.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 98ea6a12-5c58-4074-a63e-1af8d46c3647 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
19792024-10-31T20:31:51.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 98ea6a12-5c58-4074-a63e-1af8d46c3647 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
19802024-10-31T20:31:51.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2203 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 98ea6a12-5c58-4074-a63e-1af8d46c3647 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
19812024-10-31T20:31:52.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = b7e0b8fb-0764-4051-8328-e5d58170b795 roles = RoleSet { roles: {} } uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?sort_by=id_ascending
19822024-10-31T20:31:52.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = b7e0b8fb-0764-4051-8328-e5d58170b795 resource = Database result = Ok(()) uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?sort_by=id_ascending
19832024-10-31T20:31:52.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3322 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = b7e0b8fb-0764-4051-8328-e5d58170b795 response_code = 200 uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?sort_by=id_ascending
19842024-10-31T20:31:52.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = 25719ef5-dc96-4aad-98b1-0e2578d1c64f roles = RoleSet { roles: {} } uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzA4NDI3Ny1iNmFhLTQ1OWYtOGY4MS1mNGVmNGM3Yzg0M2UifX0%3D
19852024-10-31T20:31:52.819ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = 25719ef5-dc96-4aad-98b1-0e2578d1c64f resource = Database result = Ok(()) uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzA4NDI3Ny1iNmFhLTQ1OWYtOGY4MS1mNGVmNGM3Yzg0M2UifX0%3D
19862024-10-31T20:31:52.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2321 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = 25719ef5-dc96-4aad-98b1-0e2578d1c64f response_code = 200 uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzA4NDI3Ny1iNmFhLTQ1OWYtOGY4MS1mNGVmNGM3Yzg0M2UifX0%3D
19872024-10-31T20:31:52.909ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 64029854-9b7c-4813-99d0-f537b7498c0b roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
19882024-10-31T20:31:52.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 64029854-9b7c-4813-99d0-f537b7498c0b resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
19892024-10-31T20:31:52.910ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1638 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 64029854-9b7c-4813-99d0-f537b7498c0b response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
19902024-10-31T20:31:53.766ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:45856
19912024-10-31T20:31:53.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45856 req_id = d6d49d75-ce9a-4f6b-bf03-8b4c54b7d2d3 roles = RoleSet { roles: {} } uri = /metrics/producers
19922024-10-31T20:31:53.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45856 req_id = d6d49d75-ce9a-4f6b-bf03-8b4c54b7d2d3 resource = Database result = Ok(()) uri = /metrics/producers
19932024-10-31T20:31:53.776ZINFOnexus: assigned collector to new producer collector_id = 6e71f19b-440f-4a40-bbbb-fa1de5a7e58c file = nexus/src/app/oximeter.rs:76 producer_id = dbdc11ca-09be-4e87-97a8-f84248e8e42f
19942024-10-31T20:31:53.776ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9740 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45856 req_id = d6d49d75-ce9a-4f6b-bf03-8b4c54b7d2d3 response_code = 201 uri = /metrics/producers
19952024-10-31T20:31:53.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = f1efbc40-0e18-4624-87f7-3fd4cec849c2 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
19962024-10-31T20:31:53.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = f1efbc40-0e18-4624-87f7-3fd4cec849c2 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
19972024-10-31T20:31:53.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2506 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = f1efbc40-0e18-4624-87f7-3fd4cec849c2 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
19982024-10-31T20:31:54.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = f8a26ec1-99c6-44c5-8718-1006560a43c2 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
19992024-10-31T20:31:54.957ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = f8a26ec1-99c6-44c5-8718-1006560a43c2 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
20002024-10-31T20:31:54.959ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2695 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = f8a26ec1-99c6-44c5-8718-1006560a43c2 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
20012024-10-31T20:31:55.565ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:61506
20022024-10-31T20:31:55.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61506 req_id = ba960d13-a6d8-41c2-ac26-a7e0930392ef roles = RoleSet { roles: {} } uri = /metrics/producers
20032024-10-31T20:31:55.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61506 req_id = ba960d13-a6d8-41c2-ac26-a7e0930392ef resource = Database result = Ok(()) uri = /metrics/producers
20042024-10-31T20:31:55.576ZINFOnexus: assigned collector to new producer collector_id = 6e71f19b-440f-4a40-bbbb-fa1de5a7e58c file = nexus/src/app/oximeter.rs:76 producer_id = 27b3ab0c-2f83-43d0-9859-6d0be2e2cbca
20052024-10-31T20:31:55.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 11047 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61506 req_id = ba960d13-a6d8-41c2-ac26-a7e0930392ef response_code = 201 uri = /metrics/producers
20062024-10-31T20:31:55.981ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 8a6d52d8-cbd2-48a5-a80f-c65a6c607b31 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
20072024-10-31T20:31:55.981ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 8a6d52d8-cbd2-48a5-a80f-c65a6c607b31 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
20082024-10-31T20:31:55.983ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2621 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 8a6d52d8-cbd2-48a5-a80f-c65a6c607b31 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
20092024-10-31T20:31:57.005ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 1fe9c455-2823-4bb9-a58d-947351d03cd0 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
20102024-10-31T20:31:57.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 1fe9c455-2823-4bb9-a58d-947351d03cd0 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
20112024-10-31T20:31:57.007ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2261 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 1fe9c455-2823-4bb9-a58d-947351d03cd0 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
20122024-10-31T20:31:58.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 5611187e-95a1-4342-8be5-0539b54060f8 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
20132024-10-31T20:31:58.030ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 5611187e-95a1-4342-8be5-0539b54060f8 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
20142024-10-31T20:31:58.032ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2767 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 5611187e-95a1-4342-8be5-0539b54060f8 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
20152024-10-31T20:31:58.640ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
20162024-10-31T20:31:58.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20172024-10-31T20:31:58.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20182024-10-31T20:31:58.641ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
20192024-10-31T20:31:58.641ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20202024-10-31T20:31:58.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20212024-10-31T20:31:58.642ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20222024-10-31T20:31:58.645ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
20232024-10-31T20:31:58.645ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20242024-10-31T20:31:58.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20252024-10-31T20:31:58.647ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20262024-10-31T20:31:58.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20272024-10-31T20:31:58.649ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20282024-10-31T20:31:58.651ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 56b527e7-66b3-4602-a305-5dc763e7fb8b, lookup_type: ById(56b527e7-66b3-4602-a305-5dc763e7fb8b) } result = Ok(())
20292024-10-31T20:31:58.651ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20302024-10-31T20:31:58.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20312024-10-31T20:31:58.663ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b original_time_created = 2024-10-31 20:20:56.758465 UTC target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b time_created = 2024-10-31 20:20:56.758465 UTC
20322024-10-31T20:31:58.663ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.130306ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"56b527e7-66b3-4602-a305-5dc763e7fb8b","time_created":"2024-10-31T20:20:56.758465Z"}
20332024-10-31T20:31:58.670ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20342024-10-31T20:31:58.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20352024-10-31T20:31:58.671ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.060777ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
20362024-10-31T20:31:59.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 797a2b0d-f17a-4962-9c7d-b0ca63b2d1a2 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
20372024-10-31T20:31:59.052ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 797a2b0d-f17a-4962-9c7d-b0ca63b2d1a2 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
20382024-10-31T20:31:59.053ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1909 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 797a2b0d-f17a-4962-9c7d-b0ca63b2d1a2 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
20392024-10-31T20:32:00.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = a3c32aeb-aae9-4d33-b815-32fc0c435b1f roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
20402024-10-31T20:32:00.075ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = a3c32aeb-aae9-4d33-b815-32fc0c435b1f resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
20412024-10-31T20:32:00.077ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1895 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = a3c32aeb-aae9-4d33-b815-32fc0c435b1f response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
20422024-10-31T20:32:01.098ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = e886409f-6cf9-4f86-8026-5ade0e5084aa roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
20432024-10-31T20:32:01.098ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = e886409f-6cf9-4f86-8026-5ade0e5084aa resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
20442024-10-31T20:32:01.100ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2350 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = e886409f-6cf9-4f86-8026-5ade0e5084aa response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
20452024-10-31T20:32:02.123ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = f345f7b1-aa9b-4f95-bda4-68c76e445f1a roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
20462024-10-31T20:32:02.124ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = f345f7b1-aa9b-4f95-bda4-68c76e445f1a resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
20472024-10-31T20:32:02.126ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2605 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = f345f7b1-aa9b-4f95-bda4-68c76e445f1a response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
20482024-10-31T20:32:02.823ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1278 local_addr = [fd00:1122:3344:101::c]:63183 method = GET remote_addr = [fd00:1122:3344:101::d]:38560 req_id = e2d4efc7-5e2e-4ee4-b9e0-03d3b061bdf3 response_code = 200 uri = /d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
20492024-10-31T20:32:03.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = bd9cba8a-b47b-418c-bf07-383f052796d5 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
20502024-10-31T20:32:03.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = bd9cba8a-b47b-418c-bf07-383f052796d5 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
20512024-10-31T20:32:03.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2245 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = bd9cba8a-b47b-418c-bf07-383f052796d5 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
20522024-10-31T20:32:04.170ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 4525c7b5-1ec4-4bb9-a802-10fb308f292d roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
20532024-10-31T20:32:04.171ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 4525c7b5-1ec4-4bb9-a802-10fb308f292d resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
20542024-10-31T20:32:04.172ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2041 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 4525c7b5-1ec4-4bb9-a802-10fb308f292d response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
20552024-10-31T20:32:05.195ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 4e528a53-1960-4628-b66e-bd21c302a959 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
20562024-10-31T20:32:05.196ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 4e528a53-1960-4628-b66e-bd21c302a959 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
20572024-10-31T20:32:05.197ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2108 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 4e528a53-1960-4628-b66e-bd21c302a959 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
20582024-10-31T20:32:06.218ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 5a7e2a0c-052d-41f7-9111-df3edb2c3293 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
20592024-10-31T20:32:06.219ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 5a7e2a0c-052d-41f7-9111-df3edb2c3293 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
20602024-10-31T20:32:06.221ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2776 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 5a7e2a0c-052d-41f7-9111-df3edb2c3293 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
20612024-10-31T20:32:07.242ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 87cde973-627b-46f4-a0e6-7777959aa13d roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
20622024-10-31T20:32:07.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 87cde973-627b-46f4-a0e6-7777959aa13d resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
20632024-10-31T20:32:07.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2469 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 87cde973-627b-46f4-a0e6-7777959aa13d response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
20642024-10-31T20:32:07.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = 7cd33672-6d17-4cbc-a4d6-e075991621e3 roles = RoleSet { roles: {} } uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?sort_by=id_ascending
20652024-10-31T20:32:07.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = 7cd33672-6d17-4cbc-a4d6-e075991621e3 resource = Database result = Ok(()) uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?sort_by=id_ascending
20662024-10-31T20:32:07.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 5903 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = 7cd33672-6d17-4cbc-a4d6-e075991621e3 response_code = 200 uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?sort_by=id_ascending
20672024-10-31T20:32:07.822ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = 39e843a2-82c4-4304-bd6a-f50612c6d455 roles = RoleSet { roles: {} } uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzA4NDI3Ny1iNmFhLTQ1OWYtOGY4MS1mNGVmNGM3Yzg0M2UifX0%3D
20682024-10-31T20:32:07.822ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = 39e843a2-82c4-4304-bd6a-f50612c6d455 resource = Database result = Ok(()) uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzA4NDI3Ny1iNmFhLTQ1OWYtOGY4MS1mNGVmNGM3Yzg0M2UifX0%3D
20692024-10-31T20:32:07.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1985 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = 39e843a2-82c4-4304-bd6a-f50612c6d455 response_code = 200 uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzA4NDI3Ny1iNmFhLTQ1OWYtOGY4MS1mNGVmNGM3Yzg0M2UifX0%3D
20702024-10-31T20:32:08.266ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 98813086-ea70-46f2-98a9-97e324c1ec04 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
20712024-10-31T20:32:08.266ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 98813086-ea70-46f2-98a9-97e324c1ec04 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
20722024-10-31T20:32:08.268ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1797 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 98813086-ea70-46f2-98a9-97e324c1ec04 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
20732024-10-31T20:32:08.640ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
20742024-10-31T20:32:08.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20752024-10-31T20:32:08.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20762024-10-31T20:32:08.641ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
20772024-10-31T20:32:08.641ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20782024-10-31T20:32:08.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20792024-10-31T20:32:08.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20802024-10-31T20:32:08.643ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20812024-10-31T20:32:08.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20822024-10-31T20:32:08.645ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.908578ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
20832024-10-31T20:32:08.646ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
20842024-10-31T20:32:08.646ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20852024-10-31T20:32:08.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20862024-10-31T20:32:08.647ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20872024-10-31T20:32:08.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20882024-10-31T20:32:08.649ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20892024-10-31T20:32:08.651ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 56b527e7-66b3-4602-a305-5dc763e7fb8b, lookup_type: ById(56b527e7-66b3-4602-a305-5dc763e7fb8b) } result = Ok(())
20902024-10-31T20:32:08.651ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20912024-10-31T20:32:08.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20922024-10-31T20:32:08.666ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b original_time_created = 2024-10-31 20:20:56.758465 UTC target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b time_created = 2024-10-31 20:20:56.758465 UTC
20932024-10-31T20:32:08.666ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.824063ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"56b527e7-66b3-4602-a305-5dc763e7fb8b","time_created":"2024-10-31T20:20:56.758465Z"}
20942024-10-31T20:32:09.289ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = c5ca3a55-a4ea-493b-b9d6-2a65d8309d46 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
20952024-10-31T20:32:09.290ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = c5ca3a55-a4ea-493b-b9d6-2a65d8309d46 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
20962024-10-31T20:32:09.292ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2364 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = c5ca3a55-a4ea-493b-b9d6-2a65d8309d46 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
20972024-10-31T20:32:10.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 4173b8c6-0141-48e7-a2b4-81a3ac669d3e roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
20982024-10-31T20:32:10.313ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 4173b8c6-0141-48e7-a2b4-81a3ac669d3e resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
20992024-10-31T20:32:10.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2147 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 4173b8c6-0141-48e7-a2b4-81a3ac669d3e response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
21002024-10-31T20:32:11.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 0bb1e5bc-1fce-42f2-b89e-f409ed45c028 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
21012024-10-31T20:32:11.338ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 0bb1e5bc-1fce-42f2-b89e-f409ed45c028 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
21022024-10-31T20:32:11.339ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2356 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 0bb1e5bc-1fce-42f2-b89e-f409ed45c028 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
21032024-10-31T20:32:12.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 87b046a3-869f-4b35-9f0c-f0b7d8af2f86 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
21042024-10-31T20:32:12.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 87b046a3-869f-4b35-9f0c-f0b7d8af2f86 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
21052024-10-31T20:32:12.361ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1688 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 87b046a3-869f-4b35-9f0c-f0b7d8af2f86 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
21062024-10-31T20:32:13.202ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:49972
21072024-10-31T20:32:13.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:49972 req_id = b76fc4eb-4819-4b9c-b188-f5ca4fa1a78a roles = RoleSet { roles: {} } uri = /metrics/producers
21082024-10-31T20:32:13.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:49972 req_id = b76fc4eb-4819-4b9c-b188-f5ca4fa1a78a resource = Database result = Ok(()) uri = /metrics/producers
21092024-10-31T20:32:13.211ZINFOnexus: assigned collector to new producer collector_id = 6e71f19b-440f-4a40-bbbb-fa1de5a7e58c file = nexus/src/app/oximeter.rs:76 producer_id = f7084277-b6aa-459f-8f81-f4ef4c7c843e
21102024-10-31T20:32:13.211ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9293 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:49972 req_id = b76fc4eb-4819-4b9c-b188-f5ca4fa1a78a response_code = 201 uri = /metrics/producers
21112024-10-31T20:32:13.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = bb58ad81-5f68-4dc7-bd94-507b7b2d4822 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
21122024-10-31T20:32:13.383ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = bb58ad81-5f68-4dc7-bd94-507b7b2d4822 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
21132024-10-31T20:32:13.385ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2086 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = bb58ad81-5f68-4dc7-bd94-507b7b2d4822 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
21142024-10-31T20:32:14.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 475fd479-6afb-4970-a976-6593d9a7b51b roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
21152024-10-31T20:32:14.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 475fd479-6afb-4970-a976-6593d9a7b51b resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
21162024-10-31T20:32:14.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2068 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 475fd479-6afb-4970-a976-6593d9a7b51b response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
21172024-10-31T20:32:15.429ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 8923202e-89ce-498a-a8b7-fa0754b7fa56 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
21182024-10-31T20:32:15.430ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 8923202e-89ce-498a-a8b7-fa0754b7fa56 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
21192024-10-31T20:32:15.432ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2593 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 8923202e-89ce-498a-a8b7-fa0754b7fa56 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
21202024-10-31T20:32:16.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 84404d5d-25a8-4b0d-ae89-73f6b6bd8604 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
21212024-10-31T20:32:16.454ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 84404d5d-25a8-4b0d-ae89-73f6b6bd8604 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
21222024-10-31T20:32:16.455ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1674 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 84404d5d-25a8-4b0d-ae89-73f6b6bd8604 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
21232024-10-31T20:32:17.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 8addeee8-c29c-4150-878b-d1632d3d5986 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
21242024-10-31T20:32:17.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 8addeee8-c29c-4150-878b-d1632d3d5986 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
21252024-10-31T20:32:17.479ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2440 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 8addeee8-c29c-4150-878b-d1632d3d5986 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
21262024-10-31T20:32:17.826ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1344 local_addr = [fd00:1122:3344:101::c]:63183 method = GET remote_addr = [fd00:1122:3344:101::d]:38560 req_id = 820fa50a-fd83-4188-a32a-77e2e2c54f54 response_code = 200 uri = /d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
21272024-10-31T20:32:18.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 9b9fd700-e1a7-4807-a154-efef83b261ee roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
21282024-10-31T20:32:18.501ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 9b9fd700-e1a7-4807-a154-efef83b261ee resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
21292024-10-31T20:32:18.503ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2455 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 9b9fd700-e1a7-4807-a154-efef83b261ee response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
21302024-10-31T20:32:18.640ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
21312024-10-31T20:32:18.640ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-10-31 20:22:18.640753405 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
21322024-10-31T20:32:18.640ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
21332024-10-31T20:32:18.640ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
21342024-10-31T20:32:18.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21352024-10-31T20:32:18.640ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
21362024-10-31T20:32:18.640ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
21372024-10-31T20:32:18.640ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21382024-10-31T20:32:18.640ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
21392024-10-31T20:32:18.640ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
21402024-10-31T20:32:18.640ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
21412024-10-31T20:32:18.640ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
21422024-10-31T20:32:18.640ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
21432024-10-31T20:32:18.640ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
21442024-10-31T20:32:18.640ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
21452024-10-31T20:32:18.640ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
21462024-10-31T20:32:18.640ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
21472024-10-31T20:32:18.640ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
21482024-10-31T20:32:18.640ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
21492024-10-31T20:32:18.640ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
21502024-10-31T20:32:18.640ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21512024-10-31T20:32:18.640ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
21522024-10-31T20:32:18.640ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
21532024-10-31T20:32:18.640ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21542024-10-31T20:32:18.640ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
21552024-10-31T20:32:18.640ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21562024-10-31T20:32:18.641ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
21572024-10-31T20:32:18.641ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
21582024-10-31T20:32:18.641ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
21592024-10-31T20:32:18.641ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
21602024-10-31T20:32:18.641ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21612024-10-31T20:32:18.641ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
21622024-10-31T20:32:18.641ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
21632024-10-31T20:32:18.641ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
21642024-10-31T20:32:18.641ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
21652024-10-31T20:32:18.641ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
21662024-10-31T20:32:18.641ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b
21672024-10-31T20:32:18.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21682024-10-31T20:32:18.641ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 21.12\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"56b527e7-66b3-4602-a305-5dc763e7fb8b"}
21692024-10-31T20:32:18.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
21702024-10-31T20:32:18.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21712024-10-31T20:32:18.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
21722024-10-31T20:32:18.641ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
21732024-10-31T20:32:18.641ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
21742024-10-31T20:32:18.641ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
21752024-10-31T20:32:18.641ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
21762024-10-31T20:32:18.641ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
21772024-10-31T20:32:18.641ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
21782024-10-31T20:32:18.641ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 8.77\u{b5}s iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
21792024-10-31T20:32:18.641ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
21802024-10-31T20:32:18.641ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
21812024-10-31T20:32:18.641ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 2.74\u{b5}s iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
21822024-10-31T20:32:18.641ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
21832024-10-31T20:32:18.641ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
21842024-10-31T20:32:18.641ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 4.32\u{b5}s iteration = 23 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
21852024-10-31T20:32:18.641ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
21862024-10-31T20:32:18.641ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
21872024-10-31T20:32:18.641ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
21882024-10-31T20:32:18.641ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
21892024-10-31T20:32:18.641ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
21902024-10-31T20:32:18.641ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
21912024-10-31T20:32:18.641ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21922024-10-31T20:32:18.641ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
21932024-10-31T20:32:18.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
21942024-10-31T20:32:18.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21952024-10-31T20:32:18.641ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21962024-10-31T20:32:18.641ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
21972024-10-31T20:32:18.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
21982024-10-31T20:32:18.641ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 8.731\u{b5}s iteration = 23 status = {"errors":[],"records_set_to_done":[]}
21992024-10-31T20:32:18.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
22002024-10-31T20:32:18.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22012024-10-31T20:32:18.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
22022024-10-31T20:32:18.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22032024-10-31T20:32:18.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
22042024-10-31T20:32:18.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22052024-10-31T20:32:18.641ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("02376501-3235-4cfe-a1cd-82b53358d277.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a8364658-9f18-48ec-a891-264e5c9fbbb6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("a8364658-9f18-48ec-a891-264e5c9fbbb6.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1651, tv_nsec: 298516779 } })
22062024-10-31T20:32:18.641ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8e750a05-d6dd-412d-aac1-b776b5e7757f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8e764cc9-00d9-46ed-80f0-316c9e4e0a2b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f87fba37-8eb7-413a-91fe-8caa94515963.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f87fba37-8eb7-413a-91fe-8caa94515963.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1651, tv_nsec: 298521029 } })
22072024-10-31T20:32:18.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
22082024-10-31T20:32:18.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
22092024-10-31T20:32:18.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
22102024-10-31T20:32:18.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
22112024-10-31T20:32:18.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22122024-10-31T20:32:18.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22132024-10-31T20:32:18.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
22142024-10-31T20:32:18.642ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
22152024-10-31T20:32:18.642ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.271843ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
22162024-10-31T20:32:18.642ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
22172024-10-31T20:32:18.642ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.446026ms iteration = 13 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
22182024-10-31T20:32:18.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22192024-10-31T20:32:18.644ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-10-31 20:22:18.640753405 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
22202024-10-31T20:32:18.644ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.600214ms iteration = 12 status = {"expiration":"2024-10-31T20:22:18.640753405Z","pruned":[]}
22212024-10-31T20:32:18.644ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.557662ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
22222024-10-31T20:32:18.644ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22232024-10-31T20:32:18.645ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22242024-10-31T20:32:18.647ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
22252024-10-31T20:32:18.647ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22262024-10-31T20:32:18.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22272024-10-31T20:32:18.647ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
22282024-10-31T20:32:18.647ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22292024-10-31T20:32:18.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22302024-10-31T20:32:18.647ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
22312024-10-31T20:32:18.647ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22322024-10-31T20:32:18.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22332024-10-31T20:32:18.649ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22342024-10-31T20:32:18.650ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
22352024-10-31T20:32:18.650ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22362024-10-31T20:32:18.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22372024-10-31T20:32:18.650ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1651, tv_nsec: 307298473 } })
22382024-10-31T20:32:18.650ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1651, tv_nsec: 307379644 } })
22392024-10-31T20:32:18.650ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
22402024-10-31T20:32:18.651ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
22412024-10-31T20:32:18.651ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
22422024-10-31T20:32:18.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
22432024-10-31T20:32:18.651ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
22442024-10-31T20:32:18.652ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22452024-10-31T20:32:18.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22462024-10-31T20:32:18.653ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22472024-10-31T20:32:18.653ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
22482024-10-31T20:32:18.653ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22492024-10-31T20:32:18.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22502024-10-31T20:32:18.653ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22512024-10-31T20:32:18.655ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
22522024-10-31T20:32:18.655ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22532024-10-31T20:32:18.655ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 14.494245ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
22542024-10-31T20:32:18.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
22552024-10-31T20:32:18.656ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
22562024-10-31T20:32:18.656ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
22572024-10-31T20:32:18.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
22582024-10-31T20:32:18.657ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22592024-10-31T20:32:18.658ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22602024-10-31T20:32:18.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22612024-10-31T20:32:18.659ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22622024-10-31T20:32:18.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22632024-10-31T20:32:18.659ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
22642024-10-31T20:32:18.659ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
22652024-10-31T20:32:18.659ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
22662024-10-31T20:32:18.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
22672024-10-31T20:32:18.659ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
22682024-10-31T20:32:18.659ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22692024-10-31T20:32:18.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22702024-10-31T20:32:18.660ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22712024-10-31T20:32:18.660ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22722024-10-31T20:32:18.660ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1651, tv_nsec: 317577743 } })
22732024-10-31T20:32:18.660ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439
22742024-10-31T20:32:18.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22752024-10-31T20:32:18.661ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22762024-10-31T20:32:18.663ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
22772024-10-31T20:32:18.664ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
22782024-10-31T20:32:18.665ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22792024-10-31T20:32:18.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22802024-10-31T20:32:18.665ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22812024-10-31T20:32:18.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
22822024-10-31T20:32:18.666ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22832024-10-31T20:32:18.667ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22842024-10-31T20:32:18.667ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22852024-10-31T20:32:18.669ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
22862024-10-31T20:32:18.669ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22872024-10-31T20:32:18.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22882024-10-31T20:32:18.673ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
22892024-10-31T20:32:18.673ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22902024-10-31T20:32:18.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22912024-10-31T20:32:18.674ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 56b527e7-66b3-4602-a305-5dc763e7fb8b, lookup_type: ById(56b527e7-66b3-4602-a305-5dc763e7fb8b) } result = Ok(())
22922024-10-31T20:32:18.674ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22932024-10-31T20:32:18.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22942024-10-31T20:32:18.684ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
22952024-10-31T20:32:18.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
22962024-10-31T20:32:18.690ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b original_time_created = 2024-10-31 20:20:56.758465 UTC target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b time_created = 2024-10-31 20:20:56.758465 UTC
22972024-10-31T20:32:18.690ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.15307ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"56b527e7-66b3-4602-a305-5dc763e7fb8b","time_created":"2024-10-31T20:20:56.758465Z"}
22982024-10-31T20:32:18.692ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
22992024-10-31T20:32:18.692ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
23002024-10-31T20:32:18.692ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 50.992825ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
23012024-10-31T20:32:18.698ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.780307ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
23022024-10-31T20:32:18.701ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
23032024-10-31T20:32:18.701ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
23042024-10-31T20:32:18.701ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
23052024-10-31T20:32:18.701ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23062024-10-31T20:32:18.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23072024-10-31T20:32:18.701ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23082024-10-31T20:32:18.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23092024-10-31T20:32:18.704ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
23102024-10-31T20:32:18.704ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
23112024-10-31T20:32:18.704ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
23122024-10-31T20:32:18.704ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23132024-10-31T20:32:18.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23142024-10-31T20:32:18.707ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
23152024-10-31T20:32:18.707ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 65.907487ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
23162024-10-31T20:32:18.709ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
23172024-10-31T20:32:18.709ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
23182024-10-31T20:32:18.709ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
23192024-10-31T20:32:18.709ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
23202024-10-31T20:32:18.709ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 69.048822ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
23212024-10-31T20:32:18.709ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
23222024-10-31T20:32:18.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
23232024-10-31T20:32:18.714ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23242024-10-31T20:32:18.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23252024-10-31T20:32:18.717ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 76.498972ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
23262024-10-31T20:32:18.721ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23272024-10-31T20:32:18.723ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
23282024-10-31T20:32:18.723ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23292024-10-31T20:32:18.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23302024-10-31T20:32:18.745ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
23312024-10-31T20:32:18.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
23322024-10-31T20:32:18.764ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23332024-10-31T20:32:18.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23342024-10-31T20:32:18.797ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
23352024-10-31T20:32:18.808ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
23362024-10-31T20:32:18.828ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
23372024-10-31T20:32:18.828ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
23382024-10-31T20:32:18.828ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "85990de1-be6b-46cc-b298-137646bf42e6", "content-length": "26", "date": "Thu, 31 Oct 2024 20:32:18 GMT"} })
23392024-10-31T20:32:18.828ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
23402024-10-31T20:32:18.829ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
23412024-10-31T20:32:18.836ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 zone_address = fd00:1122:3344:101::2
23422024-10-31T20:32:18.836ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
23432024-10-31T20:32:18.837ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "88625f61-18ca-4086-ae24-cd186e737174", "content-length": "26", "date": "Thu, 31 Oct 2024 20:32:18 GMT"} })
23442024-10-31T20:32:18.837ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
23452024-10-31T20:32:18.840ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439
23462024-10-31T20:32:18.937ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
23472024-10-31T20:32:18.937ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
23482024-10-31T20:32:18.937ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "45ab8e6c-4f18-40e0-b591-9287c43cff2a", "content-length": "26", "date": "Thu, 31 Oct 2024 20:32:18 GMT"} })
23492024-10-31T20:32:18.937ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
23502024-10-31T20:32:18.939ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
23512024-10-31T20:32:18.959ZINFOnexus (BackgroundTasks): VPC route manager sled 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
23522024-10-31T20:32:18.959ZDEBGnexus (BackgroundTasks): client request SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
23532024-10-31T20:32:18.959ZDEBGnexus (BackgroundTasks): client response SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "2fd2ceda-fdb9-4d3e-9a4b-e33faecab839", "content-length": "372", "date": "Thu, 31 Oct 2024 20:32:18 GMT"} })
23542024-10-31T20:32:18.959ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23552024-10-31T20:32:18.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23562024-10-31T20:32:18.962ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23572024-10-31T20:32:18.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23582024-10-31T20:32:18.994ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
23592024-10-31T20:32:19.005ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23602024-10-31T20:32:19.006ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23612024-10-31T20:32:19.008ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
23622024-10-31T20:32:19.008ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
23632024-10-31T20:32:19.008ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 366.799176ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
23642024-10-31T20:32:19.008ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
23652024-10-31T20:32:19.008ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23662024-10-31T20:32:19.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23672024-10-31T20:32:19.009ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
23682024-10-31T20:32:19.009ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23692024-10-31T20:32:19.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23702024-10-31T20:32:19.011ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23712024-10-31T20:32:19.012ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23722024-10-31T20:32:19.013ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23732024-10-31T20:32:19.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23742024-10-31T20:32:19.015ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 622abb78-eb68-41c1-ac52-e7a263024e57, lookup_type: ById(622abb78-eb68-41c1-ac52-e7a263024e57) } result = Ok(())
23752024-10-31T20:32:19.015ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23762024-10-31T20:32:19.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23772024-10-31T20:32:19.016ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
23782024-10-31T20:32:19.016ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23792024-10-31T20:32:19.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23802024-10-31T20:32:19.017ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 376.853842ms iteration = 23 status = 0
23812024-10-31T20:32:19.026ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
23822024-10-31T20:32:19.026ZDEBGnexus (BackgroundTasks): client request SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
23832024-10-31T20:32:19.027ZDEBGnexus (BackgroundTasks): client response SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c3256818-e6e6-464b-953c-68807ccfd4f9", "date": "Thu, 31 Oct 2024 20:32:18 GMT"} })
23842024-10-31T20:32:19.027ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23852024-10-31T20:32:19.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23862024-10-31T20:32:19.030ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23872024-10-31T20:32:19.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23882024-10-31T20:32:19.034ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23892024-10-31T20:32:19.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23902024-10-31T20:32:19.044ZINFOnexus (BackgroundTasks): VPC route manager sled 622abb78-eb68-41c1-ac52-e7a263024e57 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
23912024-10-31T20:32:19.045ZDEBGnexus (BackgroundTasks): client request SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
23922024-10-31T20:32:19.045ZDEBGnexus (BackgroundTasks): client response SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "38d4b8cd-1dae-4ea0-bbf0-9e5785d9e5fe", "date": "Thu, 31 Oct 2024 20:32:18 GMT"} })
23932024-10-31T20:32:19.047ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 405.911752ms iteration = 24 status = {}
23942024-10-31T20:32:19.051ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-10-31T20:21:09.823788Z, time_modified: 2024-10-31T20:21:09.823788Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9efc5118-5ea4-4fe1-a8c5-501dee3e98c0, db_silo: Silo { identity: SiloIdentity { id: 9efc5118-5ea4-4fe1-a8c5-501dee3e98c0, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-31T20:21:23.039241Z, time_modified: 2024-10-31T20:21:23.039241Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "fffc2e5c59e415981668ee3af9418c2de014d1976b7a03713830fdf9f35a71e6" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9efc5118-5ea4-4fe1-a8c5-501dee3e98c0, db_silo: Silo { identity: SiloIdentity { id: 9efc5118-5ea4-4fe1-a8c5-501dee3e98c0, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-31T20:21:23.039241Z, time_modified: 2024-10-31T20:21:23.039241Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "fffc2e5c59e415981668ee3af9418c2de014d1976b7a03713830fdf9f35a71e6" }] }) }
23952024-10-31T20:32:19.051ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 409.989325ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9efc5118-5ea4-4fe1-a8c5-501dee3e98c0","tls_certs":["fffc2e5c59e415981668ee3af9418c2de014d1976b7a03713830fdf9f35a71e6"]}},"default_endpoint":{"silo_id":"9efc5118-5ea4-4fe1-a8c5-501dee3e98c0","tls_certs":["fffc2e5c59e415981668ee3af9418c2de014d1976b7a03713830fdf9f35a71e6"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
23962024-10-31T20:32:19.052ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23972024-10-31T20:32:19.055ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
23982024-10-31T20:32:19.055ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 414.286219ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
23992024-10-31T20:32:19.058ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
24002024-10-31T20:32:19.058ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 9bbba0df-c792-4ba2-925b-ab02ed6483a1 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
24012024-10-31T20:32:19.058ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24022024-10-31T20:32:19.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24032024-10-31T20:32:19.060ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
24042024-10-31T20:32:19.060ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24052024-10-31T20:32:19.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24062024-10-31T20:32:19.062ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
24072024-10-31T20:32:19.062ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 1a5173f7-64b4-48db-9160-caa5913594e3 dns_zone_name = oxide.test found_so_far = 0 version = 2
24082024-10-31T20:32:19.062ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24092024-10-31T20:32:19.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24102024-10-31T20:32:19.063ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24112024-10-31T20:32:19.063ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24122024-10-31T20:32:19.066ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
24132024-10-31T20:32:19.066ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24142024-10-31T20:32:19.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24152024-10-31T20:32:19.069ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
24162024-10-31T20:32:19.069ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24172024-10-31T20:32:19.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24182024-10-31T20:32:19.074ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 9bbba0df-c792-4ba2-925b-ab02ed6483a1 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
24192024-10-31T20:32:19.074ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
24202024-10-31T20:32:19.074ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-10-31 20:21:21.652645 UTC dns_group = internal generation = 1
24212024-10-31T20:32:19.074ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 433.101259ms iteration = 13 status = {"generation":1}
24222024-10-31T20:32:19.084ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 443.674606ms iteration = 27 status = {"physical_disks_added":0}
24232024-10-31T20:32:19.103ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
24242024-10-31T20:32:19.104ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "f609cf16-bdd1-48a5-b8c8-ce3e0e00f5c8", "date": "Thu, 31 Oct 2024 20:32:19 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24252024-10-31T20:32:19.104ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24262024-10-31T20:32:19.104ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24272024-10-31T20:32:19.104ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
24282024-10-31T20:32:19.105ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "07cc6d0c-737b-4217-b614-d74b363f119a", "content-length": "1", "date": "Thu, 31 Oct 2024 20:32:19 GMT"} })
24292024-10-31T20:32:19.111ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "776d1500-fd9f-47f9-9a2e-e5f56b518ad5", "date": "Thu, 31 Oct 2024 20:32:19 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24302024-10-31T20:32:19.111ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24312024-10-31T20:32:19.113ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
24322024-10-31T20:32:19.113ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24332024-10-31T20:32:19.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24342024-10-31T20:32:19.113ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
24352024-10-31T20:32:19.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
24362024-10-31T20:32:19.114ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24372024-10-31T20:32:19.114ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 473.646761ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
24382024-10-31T20:32:19.116ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 1a5173f7-64b4-48db-9160-caa5913594e3 dns_zone_name = oxide.test found_so_far = 1 version = 2
24392024-10-31T20:32:19.116ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
24402024-10-31T20:32:19.116ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-10-31 20:21:23.098854 UTC dns_group = external generation = 2
24412024-10-31T20:32:19.116ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 475.426283ms iteration = 13 status = {"generation":2}
24422024-10-31T20:32:19.116ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 475.477423ms iteration = 23 status = null
24432024-10-31T20:32:19.124ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 483.140368ms iteration = 23 status = {}
24442024-10-31T20:32:19.142ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
24452024-10-31T20:32:19.143ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "bb029d1c-3a98-4df8-878e-c4fd4df987e4", "date": "Thu, 31 Oct 2024 20:32:19 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
24462024-10-31T20:32:19.143ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
24472024-10-31T20:32:19.145ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "841ab84a-9928-4afb-bd9a-fee516d9955b", "date": "Thu, 31 Oct 2024 20:32:19 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
24482024-10-31T20:32:19.145ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
24492024-10-31T20:32:19.148ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "8ac5bab6-9637-4524-b38f-3ac9cfa05673", "date": "Thu, 31 Oct 2024 20:32:19 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
24502024-10-31T20:32:19.148ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
24512024-10-31T20:32:19.150ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
24522024-10-31T20:32:19.151ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 509.797546ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
24532024-10-31T20:32:19.205ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24542024-10-31T20:32:19.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24552024-10-31T20:32:19.225ZDEBGnexus (BackgroundTasks): client request SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
24562024-10-31T20:32:19.225ZDEBGnexus (BackgroundTasks): client response SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "b034e49c-3804-4ebf-b6e7-39fd69ba8312", "content-length": "691", "date": "Thu, 31 Oct 2024 20:32:18 GMT"} })
24572024-10-31T20:32:19.225ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
24582024-10-31T20:32:19.225ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
24592024-10-31T20:32:19.225ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
24602024-10-31T20:32:19.229ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 589.134248ms iteration = 23 status = {}
24612024-10-31T20:32:19.230ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2c0ce4ae-e332-4e80-bd64-c2d6cfd99f8f, rack_id: cf9a2d24-88ed-47a2-a402-0cbbba2d1439, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(1479dccf-28ea-4cc0-9964-818390bddf17) } rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 switch_location = Switch0
24622024-10-31T20:32:19.230ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24632024-10-31T20:32:19.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24642024-10-31T20:32:19.240ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
24652024-10-31T20:32:19.241ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "1ed1e95a-67c7-4fdd-b690-31152207fb7a", "content-length": "121", "date": "Thu, 31 Oct 2024 20:32:19 GMT"} })
24662024-10-31T20:32:19.241ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
24672024-10-31T20:32:19.241ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 1479dccf-28ea-4cc0-9964-818390bddf17
24682024-10-31T20:32:19.241ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
24692024-10-31T20:32:19.241ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
24702024-10-31T20:32:19.241ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24712024-10-31T20:32:19.241ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24722024-10-31T20:32:19.241ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24732024-10-31T20:32:19.241ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
24742024-10-31T20:32:19.241ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24752024-10-31T20:32:19.241ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
24762024-10-31T20:32:19.242ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439
24772024-10-31T20:32:19.242ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24782024-10-31T20:32:19.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24792024-10-31T20:32:19.245ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
24802024-10-31T20:32:19.245ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "947e0d76-0e0f-46c8-8195-7e7b812a49ff", "content-length": "2", "date": "Thu, 31 Oct 2024 20:32:19 GMT"} })
24812024-10-31T20:32:19.245ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
24822024-10-31T20:32:19.245ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "65fa8fe4-5eff-416d-8f70-6f56d03454bf", "content-length": "52", "date": "Thu, 31 Oct 2024 20:32:19 GMT"} })
24832024-10-31T20:32:19.245ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 switch_location = Switch0
24842024-10-31T20:32:19.245ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
24852024-10-31T20:32:19.370ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "75cdfaf7-e391-42d7-992d-5ab2902621a9", "date": "Thu, 31 Oct 2024 20:32:18 GMT"} })
24862024-10-31T20:32:19.370ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 switch = Switch0
24872024-10-31T20:32:19.370ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
24882024-10-31T20:32:19.370ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "be922cd7-bb64-4767-bd03-e0f3eede7d3b", "content-length": "669", "date": "Thu, 31 Oct 2024 20:32:18 GMT"} })
24892024-10-31T20:32:19.370ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24902024-10-31T20:32:19.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24912024-10-31T20:32:19.375ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24922024-10-31T20:32:19.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24932024-10-31T20:32:19.379ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24942024-10-31T20:32:19.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24952024-10-31T20:32:19.381ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24962024-10-31T20:32:19.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24972024-10-31T20:32:19.388ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 747.442875ms iteration = 23 status = {}
24982024-10-31T20:32:19.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 8c41b2a1-71a3-4877-bc44-4cbf01b78f7d roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
24992024-10-31T20:32:19.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 8c41b2a1-71a3-4877-bc44-4cbf01b78f7d resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
25002024-10-31T20:32:19.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2513 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 8c41b2a1-71a3-4877-bc44-4cbf01b78f7d response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
25012024-10-31T20:32:20.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46541 req_id = c2985c9e-2b9c-4db8-ad57-3e85efe3c896 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
25022024-10-31T20:32:20.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46541 req_id = c2985c9e-2b9c-4db8-ad57-3e85efe3c896 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
25032024-10-31T20:32:20.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3418 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46541 req_id = c2985c9e-2b9c-4db8-ad57-3e85efe3c896 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
25042024-10-31T20:32:20.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 241b46d7-74d4-4885-9933-2629156ae173 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
25052024-10-31T20:32:20.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 241b46d7-74d4-4885-9933-2629156ae173 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
25062024-10-31T20:32:20.711ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2195 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 241b46d7-74d4-4885-9933-2629156ae173 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
25072024-10-31T20:32:21.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 911de046-708d-4133-9597-a5e38d4fd3eb roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
25082024-10-31T20:32:21.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 911de046-708d-4133-9597-a5e38d4fd3eb resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
25092024-10-31T20:32:21.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1989 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 911de046-708d-4133-9597-a5e38d4fd3eb response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
25102024-10-31T20:32:22.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = e70b706c-7d06-4317-acd4-48cbe44667cb roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
25112024-10-31T20:32:22.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = e70b706c-7d06-4317-acd4-48cbe44667cb resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
25122024-10-31T20:32:22.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2736 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = e70b706c-7d06-4317-acd4-48cbe44667cb response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
25132024-10-31T20:32:22.816ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = 66d921b5-46e2-4f80-b1fd-7e8355b84620 roles = RoleSet { roles: {} } uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?sort_by=id_ascending
25142024-10-31T20:32:22.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = 66d921b5-46e2-4f80-b1fd-7e8355b84620 resource = Database result = Ok(()) uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?sort_by=id_ascending
25152024-10-31T20:32:22.819ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3305 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = 66d921b5-46e2-4f80-b1fd-7e8355b84620 response_code = 200 uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?sort_by=id_ascending
25162024-10-31T20:32:22.819ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = c1a074aa-4029-43b0-b508-520ad2383b96 roles = RoleSet { roles: {} } uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzA4NDI3Ny1iNmFhLTQ1OWYtOGY4MS1mNGVmNGM3Yzg0M2UifX0%3D
25172024-10-31T20:32:22.819ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = c1a074aa-4029-43b0-b508-520ad2383b96 resource = Database result = Ok(()) uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzA4NDI3Ny1iNmFhLTQ1OWYtOGY4MS1mNGVmNGM3Yzg0M2UifX0%3D
25182024-10-31T20:32:22.822ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2298 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = c1a074aa-4029-43b0-b508-520ad2383b96 response_code = 200 uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzA4NDI3Ny1iNmFhLTQ1OWYtOGY4MS1mNGVmNGM3Yzg0M2UifX0%3D
25192024-10-31T20:32:23.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = af1e4a98-f21e-49ad-a2a9-05b40ecd1bdd roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
25202024-10-31T20:32:23.782ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = af1e4a98-f21e-49ad-a2a9-05b40ecd1bdd resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
25212024-10-31T20:32:23.783ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1815 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = af1e4a98-f21e-49ad-a2a9-05b40ecd1bdd response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
25222024-10-31T20:32:24.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 2799a7b1-a2f9-418d-8be5-bedb6539f9f0 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
25232024-10-31T20:32:24.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 2799a7b1-a2f9-418d-8be5-bedb6539f9f0 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
25242024-10-31T20:32:24.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1770 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 2799a7b1-a2f9-418d-8be5-bedb6539f9f0 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
25252024-10-31T20:32:25.828ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 20fdab1f-f681-4033-896d-2f08ca08a835 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
25262024-10-31T20:32:25.828ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 20fdab1f-f681-4033-896d-2f08ca08a835 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
25272024-10-31T20:32:25.830ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2338 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 20fdab1f-f681-4033-896d-2f08ca08a835 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
25282024-10-31T20:32:26.853ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = e005da77-49c1-4f1a-a06c-b25342c14f1d roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
25292024-10-31T20:32:26.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = e005da77-49c1-4f1a-a06c-b25342c14f1d resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
25302024-10-31T20:32:26.855ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2387 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = e005da77-49c1-4f1a-a06c-b25342c14f1d response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
25312024-10-31T20:32:27.876ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 2c1e9839-1ac0-402e-a1df-d515b9a610de roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
25322024-10-31T20:32:27.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 2c1e9839-1ac0-402e-a1df-d515b9a610de resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
25332024-10-31T20:32:27.878ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2705 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 2c1e9839-1ac0-402e-a1df-d515b9a610de response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
25342024-10-31T20:32:28.641ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
25352024-10-31T20:32:28.641ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25362024-10-31T20:32:28.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25372024-10-31T20:32:28.642ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
25382024-10-31T20:32:28.642ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25392024-10-31T20:32:28.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25402024-10-31T20:32:28.669ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25412024-10-31T20:32:28.672ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25422024-10-31T20:32:28.672ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25432024-10-31T20:32:28.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25442024-10-31T20:32:28.672ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25452024-10-31T20:32:28.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25462024-10-31T20:32:28.674ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.47707ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25472024-10-31T20:32:28.674ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25482024-10-31T20:32:28.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25492024-10-31T20:32:28.701ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25502024-10-31T20:32:28.703ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 56b527e7-66b3-4602-a305-5dc763e7fb8b, lookup_type: ById(56b527e7-66b3-4602-a305-5dc763e7fb8b) } result = Ok(())
25512024-10-31T20:32:28.703ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25522024-10-31T20:32:28.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25532024-10-31T20:32:28.715ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b original_time_created = 2024-10-31 20:20:56.758465 UTC target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b time_created = 2024-10-31 20:20:56.758465 UTC
25542024-10-31T20:32:28.715ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 74.481407ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"56b527e7-66b3-4602-a305-5dc763e7fb8b","time_created":"2024-10-31T20:20:56.758465Z"}
25552024-10-31T20:32:28.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = d3bb0f44-9c3f-4767-b44b-087bf34a7017 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
25562024-10-31T20:32:28.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = d3bb0f44-9c3f-4767-b44b-087bf34a7017 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
25572024-10-31T20:32:28.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1771 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = d3bb0f44-9c3f-4767-b44b-087bf34a7017 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
25582024-10-31T20:32:29.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 901735fc-2a99-484f-94e1-97a80d850e90 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
25592024-10-31T20:32:29.924ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 901735fc-2a99-484f-94e1-97a80d850e90 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
25602024-10-31T20:32:29.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2269 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 901735fc-2a99-484f-94e1-97a80d850e90 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
25612024-10-31T20:32:30.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = b230461c-552a-4ca1-9c6e-ad46c85faf08 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
25622024-10-31T20:32:30.948ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = b230461c-552a-4ca1-9c6e-ad46c85faf08 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
25632024-10-31T20:32:30.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2308 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = b230461c-552a-4ca1-9c6e-ad46c85faf08 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
25642024-10-31T20:32:31.972ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 13fcc1e1-9dcb-43dd-ac2f-ef34ca90ce80 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
25652024-10-31T20:32:31.972ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 13fcc1e1-9dcb-43dd-ac2f-ef34ca90ce80 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
25662024-10-31T20:32:31.974ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2713 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 13fcc1e1-9dcb-43dd-ac2f-ef34ca90ce80 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
25672024-10-31T20:32:32.824ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1364 local_addr = [fd00:1122:3344:101::c]:63183 method = GET remote_addr = [fd00:1122:3344:101::d]:38560 req_id = dc2862b3-4eba-44a1-90a5-58f747ea588a response_code = 200 uri = /d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
25682024-10-31T20:32:32.996ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 58687462-35dc-4331-ba72-af3422f9c601 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
25692024-10-31T20:32:32.996ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 58687462-35dc-4331-ba72-af3422f9c601 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
25702024-10-31T20:32:32.998ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2244 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 58687462-35dc-4331-ba72-af3422f9c601 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
25712024-10-31T20:32:34.022ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 82c21c41-526b-45e3-886e-f9733990623d roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
25722024-10-31T20:32:34.022ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 82c21c41-526b-45e3-886e-f9733990623d resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
25732024-10-31T20:32:34.024ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2334 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 82c21c41-526b-45e3-886e-f9733990623d response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
25742024-10-31T20:32:35.046ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = cfbe24cf-a0cf-4a0b-9db1-32d9e636b3df roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
25752024-10-31T20:32:35.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = cfbe24cf-a0cf-4a0b-9db1-32d9e636b3df resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
25762024-10-31T20:32:35.048ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2603 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = cfbe24cf-a0cf-4a0b-9db1-32d9e636b3df response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
25772024-10-31T20:32:36.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = a87b1621-db00-48d2-ae36-0c67b4a76c9a roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
25782024-10-31T20:32:36.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = a87b1621-db00-48d2-ae36-0c67b4a76c9a resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
25792024-10-31T20:32:36.072ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2193 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = a87b1621-db00-48d2-ae36-0c67b4a76c9a response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
25802024-10-31T20:32:37.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = d32947d8-fa40-47b2-b277-1188ea4be68c roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
25812024-10-31T20:32:37.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = d32947d8-fa40-47b2-b277-1188ea4be68c resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
25822024-10-31T20:32:37.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2110 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = d32947d8-fa40-47b2-b277-1188ea4be68c response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
25832024-10-31T20:32:37.816ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = ba2632b3-007d-47d3-8a29-c6960ac4d64c roles = RoleSet { roles: {} } uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?sort_by=id_ascending
25842024-10-31T20:32:37.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = ba2632b3-007d-47d3-8a29-c6960ac4d64c resource = Database result = Ok(()) uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?sort_by=id_ascending
25852024-10-31T20:32:37.819ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3254 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = ba2632b3-007d-47d3-8a29-c6960ac4d64c response_code = 200 uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?sort_by=id_ascending
25862024-10-31T20:32:37.819ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = c2190c5e-8d74-4b56-8b10-1c4c85c449a9 roles = RoleSet { roles: {} } uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzA4NDI3Ny1iNmFhLTQ1OWYtOGY4MS1mNGVmNGM3Yzg0M2UifX0%3D
25872024-10-31T20:32:37.820ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = c2190c5e-8d74-4b56-8b10-1c4c85c449a9 resource = Database result = Ok(()) uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzA4NDI3Ny1iNmFhLTQ1OWYtOGY4MS1mNGVmNGM3Yzg0M2UifX0%3D
25882024-10-31T20:32:37.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2172 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = c2190c5e-8d74-4b56-8b10-1c4c85c449a9 response_code = 200 uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzA4NDI3Ny1iNmFhLTQ1OWYtOGY4MS1mNGVmNGM3Yzg0M2UifX0%3D
25892024-10-31T20:32:38.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 803bcf78-107c-4378-b625-fd812c2cbbc5 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
25902024-10-31T20:32:38.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 803bcf78-107c-4378-b625-fd812c2cbbc5 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
25912024-10-31T20:32:38.119ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2073 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 803bcf78-107c-4378-b625-fd812c2cbbc5 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
25922024-10-31T20:32:38.641ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
25932024-10-31T20:32:38.641ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25942024-10-31T20:32:38.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25952024-10-31T20:32:38.641ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
25962024-10-31T20:32:38.641ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25972024-10-31T20:32:38.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25982024-10-31T20:32:38.669ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25992024-10-31T20:32:38.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26002024-10-31T20:32:38.674ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26012024-10-31T20:32:38.677ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
26022024-10-31T20:32:38.677ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26032024-10-31T20:32:38.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26042024-10-31T20:32:38.679ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26052024-10-31T20:32:38.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26062024-10-31T20:32:38.681ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26072024-10-31T20:32:38.684ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 56b527e7-66b3-4602-a305-5dc763e7fb8b, lookup_type: ById(56b527e7-66b3-4602-a305-5dc763e7fb8b) } result = Ok(())
26082024-10-31T20:32:38.684ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26092024-10-31T20:32:38.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26102024-10-31T20:32:38.692ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b original_time_created = 2024-10-31 20:20:56.758465 UTC target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b time_created = 2024-10-31 20:20:56.758465 UTC
26112024-10-31T20:32:38.692ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 51.148147ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"56b527e7-66b3-4602-a305-5dc763e7fb8b","time_created":"2024-10-31T20:20:56.758465Z"}
26122024-10-31T20:32:38.703ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.57375ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
26132024-10-31T20:32:39.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 7fe1c9de-2bc2-4157-990d-983d463a567c roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
26142024-10-31T20:32:39.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 7fe1c9de-2bc2-4157-990d-983d463a567c resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
26152024-10-31T20:32:39.142ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2496 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 7fe1c9de-2bc2-4157-990d-983d463a567c response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
26162024-10-31T20:32:40.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = e0cc916a-734c-4d38-a847-595a9010b82e roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
26172024-10-31T20:32:40.165ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = e0cc916a-734c-4d38-a847-595a9010b82e resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
26182024-10-31T20:32:40.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1783 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = e0cc916a-734c-4d38-a847-595a9010b82e response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
26192024-10-31T20:32:41.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 7ec6d9a4-568f-46dd-9984-1c04cfa9fe30 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
26202024-10-31T20:32:41.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 7ec6d9a4-568f-46dd-9984-1c04cfa9fe30 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
26212024-10-31T20:32:41.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2271 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 7ec6d9a4-568f-46dd-9984-1c04cfa9fe30 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
26222024-10-31T20:32:42.213ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 8656abe7-5a28-48c2-b597-054b5ecd62e5 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
26232024-10-31T20:32:42.213ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 8656abe7-5a28-48c2-b597-054b5ecd62e5 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
26242024-10-31T20:32:42.215ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2059 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 8656abe7-5a28-48c2-b597-054b5ecd62e5 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
26252024-10-31T20:32:43.238ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 6f3dba34-8eb8-4eea-8a6d-4173b9a50672 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
26262024-10-31T20:32:43.238ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 6f3dba34-8eb8-4eea-8a6d-4173b9a50672 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
26272024-10-31T20:32:43.240ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2557 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 6f3dba34-8eb8-4eea-8a6d-4173b9a50672 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
26282024-10-31T20:32:44.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = a6b3bcd3-ac1f-4748-a491-4378b4332b76 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
26292024-10-31T20:32:44.264ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = a6b3bcd3-ac1f-4748-a491-4378b4332b76 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
26302024-10-31T20:32:44.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1844 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = a6b3bcd3-ac1f-4748-a491-4378b4332b76 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
26312024-10-31T20:32:45.289ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 61c8cb04-19f2-4873-9ac5-a40f23735681 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
26322024-10-31T20:32:45.289ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 61c8cb04-19f2-4873-9ac5-a40f23735681 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
26332024-10-31T20:32:45.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2225 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 61c8cb04-19f2-4873-9ac5-a40f23735681 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
26342024-10-31T20:32:46.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 1756a9c5-f6fc-4ea7-b544-d4f564fcfc01 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
26352024-10-31T20:32:46.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 1756a9c5-f6fc-4ea7-b544-d4f564fcfc01 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
26362024-10-31T20:32:46.314ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2420 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 1756a9c5-f6fc-4ea7-b544-d4f564fcfc01 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
26372024-10-31T20:32:47.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 486c07f1-d5f1-4c6d-8477-042f679ebe64 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
26382024-10-31T20:32:47.337ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 486c07f1-d5f1-4c6d-8477-042f679ebe64 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
26392024-10-31T20:32:47.339ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2413 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 486c07f1-d5f1-4c6d-8477-042f679ebe64 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
26402024-10-31T20:32:47.825ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1670 local_addr = [fd00:1122:3344:101::c]:63183 method = GET remote_addr = [fd00:1122:3344:101::d]:38560 req_id = 7c0e8d09-7046-4fe6-9b50-503ab4ec63f1 response_code = 200 uri = /d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
26412024-10-31T20:32:48.363ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 2b992f4a-8e9b-4602-afe5-64ae858fe3b7 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
26422024-10-31T20:32:48.363ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 2b992f4a-8e9b-4602-afe5-64ae858fe3b7 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
26432024-10-31T20:32:48.365ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1941 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 2b992f4a-8e9b-4602-afe5-64ae858fe3b7 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
26442024-10-31T20:32:48.641ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
26452024-10-31T20:32:48.641ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
26462024-10-31T20:32:48.641ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26472024-10-31T20:32:48.641ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
26482024-10-31T20:32:48.641ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26492024-10-31T20:32:48.641ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
26502024-10-31T20:32:48.641ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26512024-10-31T20:32:48.641ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
26522024-10-31T20:32:48.641ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
26532024-10-31T20:32:48.641ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
26542024-10-31T20:32:48.641ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
26552024-10-31T20:32:48.641ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
26562024-10-31T20:32:48.641ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
26572024-10-31T20:32:48.641ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
26582024-10-31T20:32:48.641ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
26592024-10-31T20:32:48.641ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26602024-10-31T20:32:48.641ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26612024-10-31T20:32:48.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
26622024-10-31T20:32:48.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26632024-10-31T20:32:48.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
26642024-10-31T20:32:48.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26652024-10-31T20:32:48.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
26662024-10-31T20:32:48.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26672024-10-31T20:32:48.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26682024-10-31T20:32:48.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
26692024-10-31T20:32:48.642ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
26702024-10-31T20:32:48.642ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
26712024-10-31T20:32:48.642ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
26722024-10-31T20:32:48.642ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
26732024-10-31T20:32:48.642ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26742024-10-31T20:32:48.642ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
26752024-10-31T20:32:48.642ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
26762024-10-31T20:32:48.642ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 7.96\u{b5}s iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
26772024-10-31T20:32:48.642ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
26782024-10-31T20:32:48.642ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
26792024-10-31T20:32:48.642ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 7.27\u{b5}s iteration = 24 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
26802024-10-31T20:32:48.642ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26812024-10-31T20:32:48.642ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
26822024-10-31T20:32:48.642ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 5.26\u{b5}s iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
26832024-10-31T20:32:48.642ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 2.63\u{b5}s iteration = 24 status = {"errors":[],"records_set_to_done":[]}
26842024-10-31T20:32:48.642ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
26852024-10-31T20:32:48.642ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
26862024-10-31T20:32:48.642ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
26872024-10-31T20:32:48.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26882024-10-31T20:32:48.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
26892024-10-31T20:32:48.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26902024-10-31T20:32:48.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
26912024-10-31T20:32:48.644ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26922024-10-31T20:32:48.644ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.326389ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
26932024-10-31T20:32:48.644ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26942024-10-31T20:32:48.645ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1681, tv_nsec: 301680714 } })
26952024-10-31T20:32:48.645ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26962024-10-31T20:32:48.645ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
26972024-10-31T20:32:48.646ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1681, tv_nsec: 302813374 } })
26982024-10-31T20:32:48.646ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
26992024-10-31T20:32:48.647ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
27002024-10-31T20:32:48.647ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27012024-10-31T20:32:48.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27022024-10-31T20:32:48.648ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
27032024-10-31T20:32:48.648ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27042024-10-31T20:32:48.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27052024-10-31T20:32:48.648ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27062024-10-31T20:32:48.648ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27072024-10-31T20:32:48.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27082024-10-31T20:32:48.651ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27092024-10-31T20:32:48.651ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27102024-10-31T20:32:48.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27112024-10-31T20:32:48.652ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27122024-10-31T20:32:48.652ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
27132024-10-31T20:32:48.652ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
27142024-10-31T20:32:48.652ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
27152024-10-31T20:32:48.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
27162024-10-31T20:32:48.653ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27172024-10-31T20:32:48.653ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
27182024-10-31T20:32:48.653ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27192024-10-31T20:32:48.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27202024-10-31T20:32:48.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27212024-10-31T20:32:48.654ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
27222024-10-31T20:32:48.654ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
27232024-10-31T20:32:48.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
27242024-10-31T20:32:48.655ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27252024-10-31T20:32:48.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27262024-10-31T20:32:48.655ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 13.009288ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27272024-10-31T20:32:48.655ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27282024-10-31T20:32:48.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27292024-10-31T20:32:48.656ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27302024-10-31T20:32:48.658ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
27312024-10-31T20:32:48.658ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27322024-10-31T20:32:48.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27332024-10-31T20:32:48.674ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27342024-10-31T20:32:48.676ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
27352024-10-31T20:32:48.676ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27362024-10-31T20:32:48.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27372024-10-31T20:32:48.679ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27382024-10-31T20:32:48.679ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1681, tv_nsec: 335893875 } })
27392024-10-31T20:32:48.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27402024-10-31T20:32:48.679ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439
27412024-10-31T20:32:48.681ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27422024-10-31T20:32:48.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27432024-10-31T20:32:48.684ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27442024-10-31T20:32:48.686ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
27452024-10-31T20:32:48.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
27462024-10-31T20:32:48.686ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
27472024-10-31T20:32:48.686ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27482024-10-31T20:32:48.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27492024-10-31T20:32:48.687ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 46.325293ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
27502024-10-31T20:32:48.689ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
27512024-10-31T20:32:48.689ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 47.379822ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
27522024-10-31T20:32:48.693ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
27532024-10-31T20:32:48.693ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
27542024-10-31T20:32:48.693ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
27552024-10-31T20:32:48.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
27562024-10-31T20:32:48.696ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27572024-10-31T20:32:48.698ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27582024-10-31T20:32:48.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27592024-10-31T20:32:48.700ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 56b527e7-66b3-4602-a305-5dc763e7fb8b, lookup_type: ById(56b527e7-66b3-4602-a305-5dc763e7fb8b) } result = Ok(())
27602024-10-31T20:32:48.701ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27612024-10-31T20:32:48.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27622024-10-31T20:32:48.712ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
27632024-10-31T20:32:48.712ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
27642024-10-31T20:32:48.713ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "828e685e-2df6-463f-b07b-fe69698a3b9c", "content-length": "26", "date": "Thu, 31 Oct 2024 20:32:47 GMT"} })
27652024-10-31T20:32:48.713ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
27662024-10-31T20:32:48.716ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
27672024-10-31T20:32:48.717ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b original_time_created = 2024-10-31 20:20:56.758465 UTC target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b time_created = 2024-10-31 20:20:56.758465 UTC
27682024-10-31T20:32:48.717ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 75.956123ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"56b527e7-66b3-4602-a305-5dc763e7fb8b","time_created":"2024-10-31T20:20:56.758465Z"}
27692024-10-31T20:32:48.717ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
27702024-10-31T20:32:48.717ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
27712024-10-31T20:32:48.717ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "353ca5bd-87b1-4418-be6f-7b80c9098fff", "content-length": "26", "date": "Thu, 31 Oct 2024 20:32:47 GMT"} })
27722024-10-31T20:32:48.717ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
27732024-10-31T20:32:48.719ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
27742024-10-31T20:32:48.725ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27752024-10-31T20:32:48.727ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
27762024-10-31T20:32:48.727ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
27772024-10-31T20:32:48.727ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 85.375278ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
27782024-10-31T20:32:48.728ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 622abb78-eb68-41c1-ac52-e7a263024e57, lookup_type: ById(622abb78-eb68-41c1-ac52-e7a263024e57) } result = Ok(())
27792024-10-31T20:32:48.728ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27802024-10-31T20:32:48.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27812024-10-31T20:32:48.730ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 88.769997ms iteration = 24 status = 0
27822024-10-31T20:32:48.762ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 121.38927ms iteration = 28 status = {"physical_disks_added":0}
27832024-10-31T20:32:48.798ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27842024-10-31T20:32:48.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27852024-10-31T20:32:48.800ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27862024-10-31T20:32:48.802ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
27872024-10-31T20:32:48.802ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27882024-10-31T20:32:48.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27892024-10-31T20:32:48.803ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27902024-10-31T20:32:48.805ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
27912024-10-31T20:32:48.805ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27922024-10-31T20:32:48.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27932024-10-31T20:32:48.818ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 zone_address = fd00:1122:3344:101::2
27942024-10-31T20:32:48.818ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
27952024-10-31T20:32:48.818ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a4a0ae87-1deb-4737-88eb-d33b8724c994", "content-length": "26", "date": "Thu, 31 Oct 2024 20:32:47 GMT"} })
27962024-10-31T20:32:48.818ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
27972024-10-31T20:32:48.821ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439
27982024-10-31T20:32:48.822ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 180.769122ms iteration = 24 status = {}
27992024-10-31T20:32:48.861ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
28002024-10-31T20:32:48.861ZINFOnexus (BackgroundTasks): VPC route manager sled 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
28012024-10-31T20:32:48.861ZDEBGnexus (BackgroundTasks): client request SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
28022024-10-31T20:32:48.861ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "2013f314-6cb2-4476-a6c0-29b1ff5eb239", "content-length": "1", "date": "Thu, 31 Oct 2024 20:32:48 GMT"} })
28032024-10-31T20:32:48.861ZDEBGnexus (BackgroundTasks): client response SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e5452015-12f8-4496-9e03-be7ceed93a37", "content-length": "372", "date": "Thu, 31 Oct 2024 20:32:48 GMT"} })
28042024-10-31T20:32:48.861ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28052024-10-31T20:32:48.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28062024-10-31T20:32:48.863ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
28072024-10-31T20:32:48.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
28082024-10-31T20:32:48.864ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 223.543702ms iteration = 24 status = null
28092024-10-31T20:32:48.905ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
28102024-10-31T20:32:48.906ZDEBGnexus (BackgroundTasks): client request SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
28112024-10-31T20:32:48.906ZDEBGnexus (BackgroundTasks): client response SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "52a74f20-9a97-4497-acc5-396ff0320311", "date": "Thu, 31 Oct 2024 20:32:48 GMT"} })
28122024-10-31T20:32:48.906ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28132024-10-31T20:32:48.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28142024-10-31T20:32:48.908ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28152024-10-31T20:32:48.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28162024-10-31T20:32:48.911ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28172024-10-31T20:32:48.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28182024-10-31T20:32:48.914ZINFOnexus (BackgroundTasks): VPC route manager sled 622abb78-eb68-41c1-ac52-e7a263024e57 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
28192024-10-31T20:32:48.914ZDEBGnexus (BackgroundTasks): client request SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
28202024-10-31T20:32:48.914ZDEBGnexus (BackgroundTasks): client response SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b60fc06f-c3bd-403a-8740-592059f5a1ec", "date": "Thu, 31 Oct 2024 20:32:48 GMT"} })
28212024-10-31T20:32:48.916ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 273.762074ms iteration = 25 status = {}
28222024-10-31T20:32:48.955ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28232024-10-31T20:32:48.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28242024-10-31T20:32:48.957ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2c0ce4ae-e332-4e80-bd64-c2d6cfd99f8f, rack_id: cf9a2d24-88ed-47a2-a402-0cbbba2d1439, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(1479dccf-28ea-4cc0-9964-818390bddf17) } rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 switch_location = Switch0
28252024-10-31T20:32:48.957ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28262024-10-31T20:32:48.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28272024-10-31T20:32:48.964ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
28282024-10-31T20:32:48.965ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "f03966f0-23ed-408c-a8a0-28529ab23733", "content-length": "121", "date": "Thu, 31 Oct 2024 20:32:48 GMT"} })
28292024-10-31T20:32:48.965ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
28302024-10-31T20:32:48.965ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 1479dccf-28ea-4cc0-9964-818390bddf17
28312024-10-31T20:32:48.965ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
28322024-10-31T20:32:48.965ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
28332024-10-31T20:32:48.965ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28342024-10-31T20:32:48.965ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28352024-10-31T20:32:48.965ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28362024-10-31T20:32:48.965ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
28372024-10-31T20:32:48.965ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28382024-10-31T20:32:48.965ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
28392024-10-31T20:32:48.965ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439
28402024-10-31T20:32:48.965ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28412024-10-31T20:32:48.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28422024-10-31T20:32:48.968ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
28432024-10-31T20:32:48.968ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "02d147ed-5805-4ee7-984a-2ccb5520fac2", "content-length": "2", "date": "Thu, 31 Oct 2024 20:32:48 GMT"} })
28442024-10-31T20:32:48.968ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
28452024-10-31T20:32:48.968ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "15495120-4cee-43a8-b98c-900d24e6178f", "content-length": "52", "date": "Thu, 31 Oct 2024 20:32:48 GMT"} })
28462024-10-31T20:32:48.968ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 switch_location = Switch0
28472024-10-31T20:32:48.968ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
28482024-10-31T20:32:48.968ZDEBGnexus (BackgroundTasks): client request SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
28492024-10-31T20:32:49.106ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "d2d15a8c-fc2e-499d-8c20-b99db6b2b105", "date": "Thu, 31 Oct 2024 20:32:48 GMT"} })
28502024-10-31T20:32:49.106ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 switch = Switch0
28512024-10-31T20:32:49.106ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
28522024-10-31T20:32:49.106ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "dcbcf5c3-b9f3-4c44-833b-0816f7b8d5ef", "content-length": "669", "date": "Thu, 31 Oct 2024 20:32:49 GMT"} })
28532024-10-31T20:32:49.106ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28542024-10-31T20:32:49.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28552024-10-31T20:32:49.107ZDEBGnexus (BackgroundTasks): client response SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5af14192-b46b-4981-b94a-23fdc468bf1d", "content-length": "691", "date": "Thu, 31 Oct 2024 20:32:49 GMT"} })
28562024-10-31T20:32:49.107ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
28572024-10-31T20:32:49.107ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
28582024-10-31T20:32:49.107ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
28592024-10-31T20:32:49.109ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 467.87123ms iteration = 24 status = {}
28602024-10-31T20:32:49.110ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28612024-10-31T20:32:49.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28622024-10-31T20:32:49.113ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28632024-10-31T20:32:49.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28642024-10-31T20:32:49.115ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28652024-10-31T20:32:49.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28662024-10-31T20:32:49.124ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 482.875464ms iteration = 24 status = {}
28672024-10-31T20:32:49.395ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 9a01a002-95aa-4728-ae41-f6f1daa450e8 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
28682024-10-31T20:32:49.395ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 9a01a002-95aa-4728-ae41-f6f1daa450e8 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
28692024-10-31T20:32:49.397ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2622 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 9a01a002-95aa-4728-ae41-f6f1daa450e8 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
28702024-10-31T20:32:50.174ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46541 req_id = b5142ae1-560d-4a18-940b-d8d4323a48a1 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
28712024-10-31T20:32:50.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46541 req_id = b5142ae1-560d-4a18-940b-d8d4323a48a1 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
28722024-10-31T20:32:50.177ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2763 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46541 req_id = b5142ae1-560d-4a18-940b-d8d4323a48a1 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
28732024-10-31T20:32:50.422ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = c47ae892-52d9-4bfa-bd20-f5a20cd13a72 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
28742024-10-31T20:32:50.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = c47ae892-52d9-4bfa-bd20-f5a20cd13a72 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
28752024-10-31T20:32:50.424ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2180 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = c47ae892-52d9-4bfa-bd20-f5a20cd13a72 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
28762024-10-31T20:32:51.446ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 284edb0d-8014-4811-b123-863cd265f18f roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
28772024-10-31T20:32:51.446ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 284edb0d-8014-4811-b123-863cd265f18f resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
28782024-10-31T20:32:51.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1931 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 284edb0d-8014-4811-b123-863cd265f18f response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
28792024-10-31T20:32:52.469ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 2012dfab-c0e8-4547-9468-5daacfa30858 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
28802024-10-31T20:32:52.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 2012dfab-c0e8-4547-9468-5daacfa30858 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
28812024-10-31T20:32:52.471ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2255 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 2012dfab-c0e8-4547-9468-5daacfa30858 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
28822024-10-31T20:32:53.493ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 1306163c-7a71-4488-94fe-c6881a98f00c roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
28832024-10-31T20:32:53.493ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 1306163c-7a71-4488-94fe-c6881a98f00c resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
28842024-10-31T20:32:53.495ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2277 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 1306163c-7a71-4488-94fe-c6881a98f00c response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
28852024-10-31T20:32:54.518ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 79cd9a4c-bbd6-47ba-bbc5-cd745317a414 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
28862024-10-31T20:32:54.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 79cd9a4c-bbd6-47ba-bbc5-cd745317a414 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
28872024-10-31T20:32:54.520ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2440 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 79cd9a4c-bbd6-47ba-bbc5-cd745317a414 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
28882024-10-31T20:32:55.542ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 43c99ce7-5b21-4ea4-ba0e-a7b34dd98fab roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
28892024-10-31T20:32:55.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 43c99ce7-5b21-4ea4-ba0e-a7b34dd98fab resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
28902024-10-31T20:32:55.544ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2292 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 43c99ce7-5b21-4ea4-ba0e-a7b34dd98fab response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
28912024-10-31T20:32:56.567ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 24d7d267-569f-4eea-94a6-c70c8c491a9d roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
28922024-10-31T20:32:56.567ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 24d7d267-569f-4eea-94a6-c70c8c491a9d resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
28932024-10-31T20:32:56.569ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2094 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 24d7d267-569f-4eea-94a6-c70c8c491a9d response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
28942024-10-31T20:32:57.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = e11d3826-77aa-4240-9292-6a555e3a7e4d roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
28952024-10-31T20:32:57.592ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = e11d3826-77aa-4240-9292-6a555e3a7e4d resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
28962024-10-31T20:32:57.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2691 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = e11d3826-77aa-4240-9292-6a555e3a7e4d response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
28972024-10-31T20:32:58.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 08f592d1-4ce0-4726-be09-01f92d1787b2 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
28982024-10-31T20:32:58.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 08f592d1-4ce0-4726-be09-01f92d1787b2 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
28992024-10-31T20:32:58.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2340 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 08f592d1-4ce0-4726-be09-01f92d1787b2 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
29002024-10-31T20:32:58.640ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
29012024-10-31T20:32:58.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29022024-10-31T20:32:58.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29032024-10-31T20:32:58.641ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
29042024-10-31T20:32:58.641ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29052024-10-31T20:32:58.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29062024-10-31T20:32:58.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29072024-10-31T20:32:58.643ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29082024-10-31T20:32:58.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29092024-10-31T20:32:58.645ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29102024-10-31T20:32:58.645ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29112024-10-31T20:32:58.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29122024-10-31T20:32:58.646ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.244985ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29132024-10-31T20:32:58.647ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29142024-10-31T20:32:58.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29152024-10-31T20:32:58.649ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29162024-10-31T20:32:58.651ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 56b527e7-66b3-4602-a305-5dc763e7fb8b, lookup_type: ById(56b527e7-66b3-4602-a305-5dc763e7fb8b) } result = Ok(())
29172024-10-31T20:32:58.651ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29182024-10-31T20:32:58.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29192024-10-31T20:32:58.664ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b original_time_created = 2024-10-31 20:20:56.758465 UTC target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b time_created = 2024-10-31 20:20:56.758465 UTC
29202024-10-31T20:32:58.664ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.233848ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"56b527e7-66b3-4602-a305-5dc763e7fb8b","time_created":"2024-10-31T20:20:56.758465Z"}
29212024-10-31T20:32:59.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 243f3f32-c492-4e5e-a884-6324416148d1 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
29222024-10-31T20:32:59.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 243f3f32-c492-4e5e-a884-6324416148d1 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
29232024-10-31T20:32:59.642ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2422 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 243f3f32-c492-4e5e-a884-6324416148d1 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
29242024-10-31T20:33:00.663ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = f4b7d329-3351-4774-9074-e44ee3b00559 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
29252024-10-31T20:33:00.663ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = f4b7d329-3351-4774-9074-e44ee3b00559 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
29262024-10-31T20:33:00.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1690 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = f4b7d329-3351-4774-9074-e44ee3b00559 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
29272024-10-31T20:33:01.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = db91afa4-e978-4b32-9c9f-286e29e3c5af roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
29282024-10-31T20:33:01.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = db91afa4-e978-4b32-9c9f-286e29e3c5af resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
29292024-10-31T20:33:01.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2106 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = db91afa4-e978-4b32-9c9f-286e29e3c5af response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
29302024-10-31T20:33:02.710ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 83ae26bb-7fc2-48af-abcd-ad7fcce27bd9 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
29312024-10-31T20:33:02.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 83ae26bb-7fc2-48af-abcd-ad7fcce27bd9 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
29322024-10-31T20:33:02.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2267 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 83ae26bb-7fc2-48af-abcd-ad7fcce27bd9 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
29332024-10-31T20:33:02.826ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1524 local_addr = [fd00:1122:3344:101::c]:63183 method = GET remote_addr = [fd00:1122:3344:101::d]:38560 req_id = bfbee658-0d85-459e-a9c7-4042bf5ac560 response_code = 200 uri = /d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
29342024-10-31T20:33:03.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 6e05c92c-49d5-4135-9cfd-cecdfae243de roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
29352024-10-31T20:33:03.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 6e05c92c-49d5-4135-9cfd-cecdfae243de resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
29362024-10-31T20:33:03.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2259 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 6e05c92c-49d5-4135-9cfd-cecdfae243de response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
29372024-10-31T20:33:04.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 41931365-bdff-4f9c-a672-78a8ceeeea10 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
29382024-10-31T20:33:04.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 41931365-bdff-4f9c-a672-78a8ceeeea10 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
29392024-10-31T20:33:04.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2934 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 41931365-bdff-4f9c-a672-78a8ceeeea10 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
29402024-10-31T20:33:05.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 51c75635-574b-40e2-9e55-7b8ffa216dc0 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
29412024-10-31T20:33:05.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 51c75635-574b-40e2-9e55-7b8ffa216dc0 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
29422024-10-31T20:33:05.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1864 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 51c75635-574b-40e2-9e55-7b8ffa216dc0 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
29432024-10-31T20:33:06.813ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 08d04f5e-5fc8-4c98-8e6d-bbdf7b5b401e roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
29442024-10-31T20:33:06.814ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 08d04f5e-5fc8-4c98-8e6d-bbdf7b5b401e resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
29452024-10-31T20:33:06.816ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2538 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 08d04f5e-5fc8-4c98-8e6d-bbdf7b5b401e response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
29462024-10-31T20:33:07.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 2ec340be-aca5-4a59-8a21-b1c3d51b2268 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
29472024-10-31T20:33:07.836ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 2ec340be-aca5-4a59-8a21-b1c3d51b2268 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
29482024-10-31T20:33:07.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2040 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 2ec340be-aca5-4a59-8a21-b1c3d51b2268 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
29492024-10-31T20:33:08.641ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
29502024-10-31T20:33:08.641ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29512024-10-31T20:33:08.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29522024-10-31T20:33:08.642ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
29532024-10-31T20:33:08.642ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29542024-10-31T20:33:08.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29552024-10-31T20:33:08.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29562024-10-31T20:33:08.644ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29572024-10-31T20:33:08.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29582024-10-31T20:33:08.645ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29592024-10-31T20:33:08.645ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29602024-10-31T20:33:08.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29612024-10-31T20:33:08.646ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.919849ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29622024-10-31T20:33:08.647ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29632024-10-31T20:33:08.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29642024-10-31T20:33:08.649ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29652024-10-31T20:33:08.652ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 56b527e7-66b3-4602-a305-5dc763e7fb8b, lookup_type: ById(56b527e7-66b3-4602-a305-5dc763e7fb8b) } result = Ok(())
29662024-10-31T20:33:08.652ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29672024-10-31T20:33:08.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29682024-10-31T20:33:08.662ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b original_time_created = 2024-10-31 20:20:56.758465 UTC target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b time_created = 2024-10-31 20:20:56.758465 UTC
29692024-10-31T20:33:08.662ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.126291ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"56b527e7-66b3-4602-a305-5dc763e7fb8b","time_created":"2024-10-31T20:20:56.758465Z"}
29702024-10-31T20:33:08.860ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 6bd2d4ee-34cd-489a-a2b6-424ea14541c9 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
29712024-10-31T20:33:08.860ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 6bd2d4ee-34cd-489a-a2b6-424ea14541c9 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
29722024-10-31T20:33:08.862ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1877 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 6bd2d4ee-34cd-489a-a2b6-424ea14541c9 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
29732024-10-31T20:33:09.884ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = d1ff7be4-42d0-49df-b440-49366364c3ca roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
29742024-10-31T20:33:09.884ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = d1ff7be4-42d0-49df-b440-49366364c3ca resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
29752024-10-31T20:33:09.885ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1626 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = d1ff7be4-42d0-49df-b440-49366364c3ca response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
29762024-10-31T20:33:10.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 51e5ff8b-6bcb-4539-8f9b-02115995147d roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
29772024-10-31T20:33:10.908ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 51e5ff8b-6bcb-4539-8f9b-02115995147d resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
29782024-10-31T20:33:10.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2325 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 51e5ff8b-6bcb-4539-8f9b-02115995147d response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
29792024-10-31T20:33:11.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = f9f77a6a-aec1-48b6-8a18-ec2c3357c352 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
29802024-10-31T20:33:11.932ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = f9f77a6a-aec1-48b6-8a18-ec2c3357c352 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
29812024-10-31T20:33:11.933ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1790 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = f9f77a6a-aec1-48b6-8a18-ec2c3357c352 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
29822024-10-31T20:33:12.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = f546bb91-c0c1-4a7f-b3b9-37d1e40b408e roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
29832024-10-31T20:33:12.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = f546bb91-c0c1-4a7f-b3b9-37d1e40b408e resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
29842024-10-31T20:33:12.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2338 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = f546bb91-c0c1-4a7f-b3b9-37d1e40b408e response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
29852024-10-31T20:33:13.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 462e7e87-ef99-44dc-8b4e-cca4e13e2eb5 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
29862024-10-31T20:33:13.980ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 462e7e87-ef99-44dc-8b4e-cca4e13e2eb5 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
29872024-10-31T20:33:13.982ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2590 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 462e7e87-ef99-44dc-8b4e-cca4e13e2eb5 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
29882024-10-31T20:33:15.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 8554c44f-5810-4b28-80dc-2172b493f920 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
29892024-10-31T20:33:15.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 8554c44f-5810-4b28-80dc-2172b493f920 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
29902024-10-31T20:33:15.006ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1947 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 8554c44f-5810-4b28-80dc-2172b493f920 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
29912024-10-31T20:33:16.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 58230aa8-37e0-4c25-87c6-f9cc1d98ce74 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
29922024-10-31T20:33:16.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 58230aa8-37e0-4c25-87c6-f9cc1d98ce74 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
29932024-10-31T20:33:16.031ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2663 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 58230aa8-37e0-4c25-87c6-f9cc1d98ce74 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
29942024-10-31T20:33:17.055ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 7e2e2cbe-e6da-4690-aea4-d2daad9ab58a roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
29952024-10-31T20:33:17.055ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 7e2e2cbe-e6da-4690-aea4-d2daad9ab58a resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
29962024-10-31T20:33:17.057ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2022 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 7e2e2cbe-e6da-4690-aea4-d2daad9ab58a response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
29972024-10-31T20:33:17.825ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1718 local_addr = [fd00:1122:3344:101::c]:63183 method = GET remote_addr = [fd00:1122:3344:101::d]:38560 req_id = 7d35607d-2046-43c9-9108-f9de88595fbb response_code = 200 uri = /d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
29982024-10-31T20:33:18.078ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = f4e7c5d2-eb07-4e82-821c-54b99f20d96b roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
29992024-10-31T20:33:18.079ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = f4e7c5d2-eb07-4e82-821c-54b99f20d96b resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
30002024-10-31T20:33:18.081ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2326 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = f4e7c5d2-eb07-4e82-821c-54b99f20d96b response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
30012024-10-31T20:33:18.641ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
30022024-10-31T20:33:18.641ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-10-31 20:23:18.641283653 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
30032024-10-31T20:33:18.641ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
30042024-10-31T20:33:18.641ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
30052024-10-31T20:33:18.641ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
30062024-10-31T20:33:18.641ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
30072024-10-31T20:33:18.641ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
30082024-10-31T20:33:18.641ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
30092024-10-31T20:33:18.641ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
30102024-10-31T20:33:18.641ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
30112024-10-31T20:33:18.641ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
30122024-10-31T20:33:18.641ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
30132024-10-31T20:33:18.641ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
30142024-10-31T20:33:18.641ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
30152024-10-31T20:33:18.641ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
30162024-10-31T20:33:18.641ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
30172024-10-31T20:33:18.641ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
30182024-10-31T20:33:18.641ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30192024-10-31T20:33:18.641ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
30202024-10-31T20:33:18.641ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
30212024-10-31T20:33:18.641ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b
30222024-10-31T20:33:18.641ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 17.5\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"56b527e7-66b3-4602-a305-5dc763e7fb8b"}
30232024-10-31T20:33:18.641ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
30242024-10-31T20:33:18.641ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
30252024-10-31T20:33:18.641ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
30262024-10-31T20:33:18.641ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30272024-10-31T20:33:18.641ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
30282024-10-31T20:33:18.641ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30292024-10-31T20:33:18.641ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
30302024-10-31T20:33:18.641ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
30312024-10-31T20:33:18.641ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
30322024-10-31T20:33:18.641ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
30332024-10-31T20:33:18.641ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
30342024-10-31T20:33:18.641ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
30352024-10-31T20:33:18.641ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
30362024-10-31T20:33:18.641ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
30372024-10-31T20:33:18.641ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
30382024-10-31T20:33:18.641ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30392024-10-31T20:33:18.641ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Timeout
30402024-10-31T20:33:18.641ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30412024-10-31T20:33:18.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
30422024-10-31T20:33:18.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
30432024-10-31T20:33:18.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30442024-10-31T20:33:18.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
30452024-10-31T20:33:18.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
30462024-10-31T20:33:18.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30472024-10-31T20:33:18.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30482024-10-31T20:33:18.642ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
30492024-10-31T20:33:18.642ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
30502024-10-31T20:33:18.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
30512024-10-31T20:33:18.642ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
30522024-10-31T20:33:18.642ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
30532024-10-31T20:33:18.642ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
30542024-10-31T20:33:18.642ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
30552024-10-31T20:33:18.642ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30562024-10-31T20:33:18.642ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 8.401\u{b5}s iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
30572024-10-31T20:33:18.642ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30582024-10-31T20:33:18.642ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
30592024-10-31T20:33:18.642ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
30602024-10-31T20:33:18.642ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
30612024-10-31T20:33:18.642ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
30622024-10-31T20:33:18.642ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 5.54\u{b5}s iteration = 25 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
30632024-10-31T20:33:18.642ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
30642024-10-31T20:33:18.642ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 6.39\u{b5}s iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
30652024-10-31T20:33:18.642ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
30662024-10-31T20:33:18.642ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
30672024-10-31T20:33:18.642ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
30682024-10-31T20:33:18.642ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 5.25\u{b5}s iteration = 25 status = {"errors":[],"records_set_to_done":[]}
30692024-10-31T20:33:18.642ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
30702024-10-31T20:33:18.642ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30712024-10-31T20:33:18.642ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
30722024-10-31T20:33:18.642ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
30732024-10-31T20:33:18.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30742024-10-31T20:33:18.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
30752024-10-31T20:33:18.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
30762024-10-31T20:33:18.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30772024-10-31T20:33:18.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
30782024-10-31T20:33:18.642ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("02376501-3235-4cfe-a1cd-82b53358d277.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a8364658-9f18-48ec-a891-264e5c9fbbb6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("a8364658-9f18-48ec-a891-264e5c9fbbb6.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1711, tv_nsec: 298521369 } })
30792024-10-31T20:33:18.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
30802024-10-31T20:33:18.642ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
30812024-10-31T20:33:18.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30822024-10-31T20:33:18.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30832024-10-31T20:33:18.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30842024-10-31T20:33:18.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
30852024-10-31T20:33:18.642ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8e750a05-d6dd-412d-aac1-b776b5e7757f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8e764cc9-00d9-46ed-80f0-316c9e4e0a2b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f87fba37-8eb7-413a-91fe-8caa94515963.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f87fba37-8eb7-413a-91fe-8caa94515963.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1711, tv_nsec: 298785434 } })
30862024-10-31T20:33:18.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
30872024-10-31T20:33:18.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
30882024-10-31T20:33:18.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
30892024-10-31T20:33:18.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
30902024-10-31T20:33:18.642ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
30912024-10-31T20:33:18.642ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
30922024-10-31T20:33:18.642ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.287962ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
30932024-10-31T20:33:18.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
30942024-10-31T20:33:18.642ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
30952024-10-31T20:33:18.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
30962024-10-31T20:33:18.642ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
30972024-10-31T20:33:18.643ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
30982024-10-31T20:33:18.643ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.488016ms iteration = 14 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
30992024-10-31T20:33:18.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
31002024-10-31T20:33:18.644ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1711, tv_nsec: 300740938 } })
31012024-10-31T20:33:18.644ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
31022024-10-31T20:33:18.644ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31032024-10-31T20:33:18.645ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31042024-10-31T20:33:18.645ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.53827ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
31052024-10-31T20:33:18.645ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31062024-10-31T20:33:18.646ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-10-31 20:23:18.641283653 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
31072024-10-31T20:33:18.646ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.896226ms iteration = 13 status = {"expiration":"2024-10-31T20:23:18.641283653Z","pruned":[]}
31082024-10-31T20:33:18.646ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31092024-10-31T20:33:18.647ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
31102024-10-31T20:33:18.647ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31112024-10-31T20:33:18.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31122024-10-31T20:33:18.649ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
31132024-10-31T20:33:18.649ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
31142024-10-31T20:33:18.649ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
31152024-10-31T20:33:18.649ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31162024-10-31T20:33:18.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
31172024-10-31T20:33:18.649ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31182024-10-31T20:33:18.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31192024-10-31T20:33:18.649ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
31202024-10-31T20:33:18.649ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31212024-10-31T20:33:18.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31222024-10-31T20:33:18.650ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31232024-10-31T20:33:18.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31242024-10-31T20:33:18.651ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31252024-10-31T20:33:18.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31262024-10-31T20:33:18.651ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31272024-10-31T20:33:18.651ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
31282024-10-31T20:33:18.651ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31292024-10-31T20:33:18.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31302024-10-31T20:33:18.652ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1711, tv_nsec: 309133275 } })
31312024-10-31T20:33:18.653ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
31322024-10-31T20:33:18.654ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
31332024-10-31T20:33:18.654ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31342024-10-31T20:33:18.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31352024-10-31T20:33:18.655ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31362024-10-31T20:33:18.656ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31372024-10-31T20:33:18.658ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
31382024-10-31T20:33:18.658ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
31392024-10-31T20:33:18.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
31402024-10-31T20:33:18.659ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
31412024-10-31T20:33:18.659ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31422024-10-31T20:33:18.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31432024-10-31T20:33:18.661ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 18.913292ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
31442024-10-31T20:33:18.666ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31452024-10-31T20:33:18.668ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31462024-10-31T20:33:18.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31472024-10-31T20:33:18.669ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31482024-10-31T20:33:18.669ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
31492024-10-31T20:33:18.669ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
31502024-10-31T20:33:18.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
31512024-10-31T20:33:18.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31522024-10-31T20:33:18.671ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31532024-10-31T20:33:18.672ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31542024-10-31T20:33:18.673ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1711, tv_nsec: 330092673 } })
31552024-10-31T20:33:18.674ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439
31562024-10-31T20:33:18.674ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31572024-10-31T20:33:18.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31582024-10-31T20:33:18.676ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
31592024-10-31T20:33:18.676ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
31602024-10-31T20:33:18.679ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31612024-10-31T20:33:18.679ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31622024-10-31T20:33:18.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31632024-10-31T20:33:18.684ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
31642024-10-31T20:33:18.684ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31652024-10-31T20:33:18.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31662024-10-31T20:33:18.687ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31672024-10-31T20:33:18.687ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31682024-10-31T20:33:18.692ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
31692024-10-31T20:33:18.692ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 56b527e7-66b3-4602-a305-5dc763e7fb8b, lookup_type: ById(56b527e7-66b3-4602-a305-5dc763e7fb8b) } result = Ok(())
31702024-10-31T20:33:18.692ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31712024-10-31T20:33:18.692ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31722024-10-31T20:33:18.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31732024-10-31T20:33:18.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31742024-10-31T20:33:18.710ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b original_time_created = 2024-10-31 20:20:56.758465 UTC target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b time_created = 2024-10-31 20:20:56.758465 UTC
31752024-10-31T20:33:18.710ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 68.997071ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"56b527e7-66b3-4602-a305-5dc763e7fb8b","time_created":"2024-10-31T20:20:56.758465Z"}
31762024-10-31T20:33:18.710ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31772024-10-31T20:33:18.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31782024-10-31T20:33:18.718ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
31792024-10-31T20:33:18.718ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
31802024-10-31T20:33:18.718ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31812024-10-31T20:33:18.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
31822024-10-31T20:33:18.719ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31832024-10-31T20:33:18.720ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31842024-10-31T20:33:18.721ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
31852024-10-31T20:33:18.721ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
31862024-10-31T20:33:18.721ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 79.460124ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
31872024-10-31T20:33:18.722ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
31882024-10-31T20:33:18.722ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
31892024-10-31T20:33:18.722ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
31902024-10-31T20:33:18.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
31912024-10-31T20:33:18.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
31922024-10-31T20:33:18.723ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
31932024-10-31T20:33:18.723ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
31942024-10-31T20:33:18.723ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 81.934568ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
31952024-10-31T20:33:18.723ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31962024-10-31T20:33:18.724ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
31972024-10-31T20:33:18.724ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
31982024-10-31T20:33:18.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
31992024-10-31T20:33:18.725ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32002024-10-31T20:33:18.726ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
32012024-10-31T20:33:18.726ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
32022024-10-31T20:33:18.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
32032024-10-31T20:33:18.726ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32042024-10-31T20:33:18.728ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
32052024-10-31T20:33:18.728ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32062024-10-31T20:33:18.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32072024-10-31T20:33:18.729ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
32082024-10-31T20:33:18.729ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
32092024-10-31T20:33:18.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
32102024-10-31T20:33:18.731ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
32112024-10-31T20:33:18.731ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
32122024-10-31T20:33:18.731ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
32132024-10-31T20:33:18.731ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32142024-10-31T20:33:18.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32152024-10-31T20:33:18.733ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 92.245449ms iteration = 6 status = {"nsuccess":5}
32162024-10-31T20:33:18.734ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
32172024-10-31T20:33:18.734ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
32182024-10-31T20:33:18.734ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
32192024-10-31T20:33:18.734ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32202024-10-31T20:33:18.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32212024-10-31T20:33:18.736ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32222024-10-31T20:33:18.737ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32232024-10-31T20:33:18.737ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
32242024-10-31T20:33:18.737ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 95.606298ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
32252024-10-31T20:33:18.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32262024-10-31T20:33:18.739ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32272024-10-31T20:33:18.739ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
32282024-10-31T20:33:18.739ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32292024-10-31T20:33:18.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32302024-10-31T20:33:18.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32312024-10-31T20:33:18.745ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
32322024-10-31T20:33:18.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
32332024-10-31T20:33:18.756ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
32342024-10-31T20:33:18.756ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
32352024-10-31T20:33:18.756ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
32362024-10-31T20:33:18.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
32372024-10-31T20:33:18.756ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 114.503689ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32382024-10-31T20:33:18.767ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 125.951171ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
32392024-10-31T20:33:18.769ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 128.176659ms iteration = 29 status = {"physical_disks_added":0}
32402024-10-31T20:33:18.803ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32412024-10-31T20:33:18.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32422024-10-31T20:33:18.805ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
32432024-10-31T20:33:18.805ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
32442024-10-31T20:33:18.806ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f095b6bf-7548-483e-a898-e4546dc0c976", "content-length": "26", "date": "Thu, 31 Oct 2024 20:33:17 GMT"} })
32452024-10-31T20:33:18.806ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
32462024-10-31T20:33:18.808ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
32472024-10-31T20:33:18.835ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 zone_address = fd00:1122:3344:101::2
32482024-10-31T20:33:18.835ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
32492024-10-31T20:33:18.835ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "db484dd4-fe07-4df4-b7ab-b8c2717536bf", "content-length": "26", "date": "Thu, 31 Oct 2024 20:33:18 GMT"} })
32502024-10-31T20:33:18.835ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
32512024-10-31T20:33:18.838ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439
32522024-10-31T20:33:18.914ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
32532024-10-31T20:33:18.915ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
32542024-10-31T20:33:18.915ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9866d545-737e-45aa-b6d9-a2d18d374abd", "content-length": "26", "date": "Thu, 31 Oct 2024 20:33:18 GMT"} })
32552024-10-31T20:33:18.915ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
32562024-10-31T20:33:18.917ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
32572024-10-31T20:33:18.918ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
32582024-10-31T20:33:18.955ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
32592024-10-31T20:33:19.035ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
32602024-10-31T20:33:19.035ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d56e4af-149b-46b1-8bee-81689842e4b5", "content-length": "1", "date": "Thu, 31 Oct 2024 20:33:18 GMT"} })
32612024-10-31T20:33:19.037ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
32622024-10-31T20:33:19.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
32632024-10-31T20:33:19.080ZINFOnexus (BackgroundTasks): VPC route manager sled 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
32642024-10-31T20:33:19.080ZDEBGnexus (BackgroundTasks): client request SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
32652024-10-31T20:33:19.081ZDEBGnexus (BackgroundTasks): client response SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "52c8e16d-7546-464f-af50-722e1efe2c38", "content-length": "372", "date": "Thu, 31 Oct 2024 20:33:19 GMT"} })
32662024-10-31T20:33:19.081ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32672024-10-31T20:33:19.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32682024-10-31T20:33:19.082ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32692024-10-31T20:33:19.085ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32702024-10-31T20:33:19.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32712024-10-31T20:33:19.086ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
32722024-10-31T20:33:19.086ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32732024-10-31T20:33:19.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32742024-10-31T20:33:19.089ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 448.531401ms iteration = 25 status = null
32752024-10-31T20:33:19.090ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32762024-10-31T20:33:19.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 622abb78-eb68-41c1-ac52-e7a263024e57, lookup_type: ById(622abb78-eb68-41c1-ac52-e7a263024e57) } result = Ok(())
32772024-10-31T20:33:19.094ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32782024-10-31T20:33:19.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32792024-10-31T20:33:19.097ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 455.720947ms iteration = 25 status = 0
32802024-10-31T20:33:19.102ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 4720e7b7-32d5-48f2-aef1-99aea26e00dd roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
32812024-10-31T20:33:19.102ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 4720e7b7-32d5-48f2-aef1-99aea26e00dd resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
32822024-10-31T20:33:19.108ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 6117 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 4720e7b7-32d5-48f2-aef1-99aea26e00dd response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
32832024-10-31T20:33:19.121ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 479.896691ms iteration = 25 status = {}
32842024-10-31T20:33:19.132ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32852024-10-31T20:33:19.135ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
32862024-10-31T20:33:19.135ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 1a5173f7-64b4-48db-9160-caa5913594e3 dns_zone_name = oxide.test found_so_far = 0 version = 2
32872024-10-31T20:33:19.135ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32882024-10-31T20:33:19.135ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
32892024-10-31T20:33:19.135ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32902024-10-31T20:33:19.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32912024-10-31T20:33:19.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32922024-10-31T20:33:19.137ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
32932024-10-31T20:33:19.137ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 9bbba0df-c792-4ba2-925b-ab02ed6483a1 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
32942024-10-31T20:33:19.137ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32952024-10-31T20:33:19.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32962024-10-31T20:33:19.138ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32972024-10-31T20:33:19.142ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
32982024-10-31T20:33:19.142ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
32992024-10-31T20:33:19.142ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 499.891161ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
33002024-10-31T20:33:19.142ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
33012024-10-31T20:33:19.142ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33022024-10-31T20:33:19.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33032024-10-31T20:33:19.146ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 1a5173f7-64b4-48db-9160-caa5913594e3 dns_zone_name = oxide.test found_so_far = 1 version = 2
33042024-10-31T20:33:19.146ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
33052024-10-31T20:33:19.146ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-10-31 20:21:23.098854 UTC dns_group = external generation = 2
33062024-10-31T20:33:19.146ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 504.742137ms iteration = 14 status = {"generation":2}
33072024-10-31T20:33:19.167ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
33082024-10-31T20:33:19.168ZDEBGnexus (BackgroundTasks): client request SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
33092024-10-31T20:33:19.168ZDEBGnexus (BackgroundTasks): client response SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f85f2df1-75a9-4696-b71d-eb25e3b57008", "date": "Thu, 31 Oct 2024 20:33:19 GMT"} })
33102024-10-31T20:33:19.168ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33112024-10-31T20:33:19.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33122024-10-31T20:33:19.172ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33132024-10-31T20:33:19.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33142024-10-31T20:33:19.175ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33152024-10-31T20:33:19.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33162024-10-31T20:33:19.179ZINFOnexus (BackgroundTasks): VPC route manager sled 622abb78-eb68-41c1-ac52-e7a263024e57 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
33172024-10-31T20:33:19.179ZDEBGnexus (BackgroundTasks): client request SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
33182024-10-31T20:33:19.179ZDEBGnexus (BackgroundTasks): client response SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "aa194ac2-9ca4-425f-b47c-ba02c61f425c", "date": "Thu, 31 Oct 2024 20:33:19 GMT"} })
33192024-10-31T20:33:19.182ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 540.058477ms iteration = 26 status = {}
33202024-10-31T20:33:19.183ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
33212024-10-31T20:33:19.183ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "4b7eae81-a80d-4567-a188-2a75cca55b1c", "date": "Thu, 31 Oct 2024 20:33:19 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
33222024-10-31T20:33:19.183ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
33232024-10-31T20:33:19.185ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "9fa4c2aa-4bc2-4e97-a771-67052709a3d3", "date": "Thu, 31 Oct 2024 20:33:19 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
33242024-10-31T20:33:19.185ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
33252024-10-31T20:33:19.186ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33262024-10-31T20:33:19.187ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
33272024-10-31T20:33:19.187ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 545.562573ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
33282024-10-31T20:33:19.190ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
33292024-10-31T20:33:19.190ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33302024-10-31T20:33:19.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33312024-10-31T20:33:19.192ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 9bbba0df-c792-4ba2-925b-ab02ed6483a1 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
33322024-10-31T20:33:19.192ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
33332024-10-31T20:33:19.192ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-10-31 20:21:21.652645 UTC dns_group = internal generation = 1
33342024-10-31T20:33:19.192ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 551.321094ms iteration = 14 status = {"generation":1}
33352024-10-31T20:33:19.199ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-10-31T20:21:09.823788Z, time_modified: 2024-10-31T20:21:09.823788Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9efc5118-5ea4-4fe1-a8c5-501dee3e98c0, db_silo: Silo { identity: SiloIdentity { id: 9efc5118-5ea4-4fe1-a8c5-501dee3e98c0, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-31T20:21:23.039241Z, time_modified: 2024-10-31T20:21:23.039241Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "fffc2e5c59e415981668ee3af9418c2de014d1976b7a03713830fdf9f35a71e6" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9efc5118-5ea4-4fe1-a8c5-501dee3e98c0, db_silo: Silo { identity: SiloIdentity { id: 9efc5118-5ea4-4fe1-a8c5-501dee3e98c0, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-31T20:21:23.039241Z, time_modified: 2024-10-31T20:21:23.039241Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "fffc2e5c59e415981668ee3af9418c2de014d1976b7a03713830fdf9f35a71e6" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
33362024-10-31T20:33:19.199ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 558.217386ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9efc5118-5ea4-4fe1-a8c5-501dee3e98c0","tls_certs":["fffc2e5c59e415981668ee3af9418c2de014d1976b7a03713830fdf9f35a71e6"]}},"default_endpoint":{"silo_id":"9efc5118-5ea4-4fe1-a8c5-501dee3e98c0","tls_certs":["fffc2e5c59e415981668ee3af9418c2de014d1976b7a03713830fdf9f35a71e6"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
33372024-10-31T20:33:19.203ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
33382024-10-31T20:33:19.205ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
33392024-10-31T20:33:19.205ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 563.257184ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
33402024-10-31T20:33:19.226ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33412024-10-31T20:33:19.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33422024-10-31T20:33:19.258ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33432024-10-31T20:33:19.260ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
33442024-10-31T20:33:19.260ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33452024-10-31T20:33:19.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33462024-10-31T20:33:19.261ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33472024-10-31T20:33:19.263ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
33482024-10-31T20:33:19.263ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33492024-10-31T20:33:19.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33502024-10-31T20:33:19.264ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
33512024-10-31T20:33:19.265ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "e7520be7-9f88-4246-a2ac-e66608ad826f", "date": "Thu, 31 Oct 2024 20:33:19 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
33522024-10-31T20:33:19.265ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
33532024-10-31T20:33:19.266ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "dad47801-b7eb-4682-816e-107d0e4e065f", "date": "Thu, 31 Oct 2024 20:33:19 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
33542024-10-31T20:33:19.266ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
33552024-10-31T20:33:19.269ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "6ada0b5d-e9ea-427d-aee4-75fe7de4fba9", "date": "Thu, 31 Oct 2024 20:33:19 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
33562024-10-31T20:33:19.269ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
33572024-10-31T20:33:19.270ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33582024-10-31T20:33:19.270ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
33592024-10-31T20:33:19.270ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 629.606338ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
33602024-10-31T20:33:19.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33612024-10-31T20:33:19.272ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2c0ce4ae-e332-4e80-bd64-c2d6cfd99f8f, rack_id: cf9a2d24-88ed-47a2-a402-0cbbba2d1439, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(1479dccf-28ea-4cc0-9964-818390bddf17) } rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 switch_location = Switch0
33622024-10-31T20:33:19.272ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33632024-10-31T20:33:19.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33642024-10-31T20:33:19.282ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
33652024-10-31T20:33:19.282ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "89cfd48f-b1d9-4956-89ba-0fb18c821ef0", "content-length": "121", "date": "Thu, 31 Oct 2024 20:33:18 GMT"} })
33662024-10-31T20:33:19.282ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
33672024-10-31T20:33:19.282ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 1479dccf-28ea-4cc0-9964-818390bddf17
33682024-10-31T20:33:19.283ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
33692024-10-31T20:33:19.283ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
33702024-10-31T20:33:19.283ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
33712024-10-31T20:33:19.283ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
33722024-10-31T20:33:19.283ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
33732024-10-31T20:33:19.283ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
33742024-10-31T20:33:19.283ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
33752024-10-31T20:33:19.283ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
33762024-10-31T20:33:19.283ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439
33772024-10-31T20:33:19.283ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33782024-10-31T20:33:19.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33792024-10-31T20:33:19.285ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
33802024-10-31T20:33:19.285ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "f54936fc-42ca-4895-9bb4-24d165329087", "content-length": "2", "date": "Thu, 31 Oct 2024 20:33:18 GMT"} })
33812024-10-31T20:33:19.285ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
33822024-10-31T20:33:19.285ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "cb903164-4eef-40fc-9d12-608a01b58a89", "content-length": "52", "date": "Thu, 31 Oct 2024 20:33:18 GMT"} })
33832024-10-31T20:33:19.285ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 switch_location = Switch0
33842024-10-31T20:33:19.285ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
33852024-10-31T20:33:19.368ZDEBGnexus (BackgroundTasks): client request SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
33862024-10-31T20:33:19.402ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "ee7d46ff-3608-4494-aeb4-4c0696af6929", "date": "Thu, 31 Oct 2024 20:33:19 GMT"} })
33872024-10-31T20:33:19.402ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 switch = Switch0
33882024-10-31T20:33:19.402ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
33892024-10-31T20:33:19.402ZDEBGnexus (BackgroundTasks): client response SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "6fb2a323-8e5f-4be7-a04c-429cd18ace74", "content-length": "691", "date": "Thu, 31 Oct 2024 20:33:19 GMT"} })
33902024-10-31T20:33:19.402ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
33912024-10-31T20:33:19.402ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
33922024-10-31T20:33:19.402ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
33932024-10-31T20:33:19.403ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6876c7da-332a-4b4e-b0a4-b45669ed3b35", "content-length": "669", "date": "Thu, 31 Oct 2024 20:33:19 GMT"} })
33942024-10-31T20:33:19.403ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33952024-10-31T20:33:19.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33962024-10-31T20:33:19.404ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 762.986318ms iteration = 25 status = {}
33972024-10-31T20:33:19.407ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33982024-10-31T20:33:19.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33992024-10-31T20:33:19.411ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34002024-10-31T20:33:19.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34012024-10-31T20:33:19.413ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34022024-10-31T20:33:19.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34032024-10-31T20:33:19.421ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 779.66355ms iteration = 25 status = {}
34042024-10-31T20:33:20.136ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 412d8dac-4a8c-4ab8-bbf7-25f1967c86a9 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
34052024-10-31T20:33:20.137ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 412d8dac-4a8c-4ab8-bbf7-25f1967c86a9 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
34062024-10-31T20:33:20.139ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2278 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 412d8dac-4a8c-4ab8-bbf7-25f1967c86a9 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
34072024-10-31T20:33:20.209ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46541 req_id = 4cd359fa-c838-4d36-bb72-73402c89a68f roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
34082024-10-31T20:33:20.209ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46541 req_id = 4cd359fa-c838-4d36-bb72-73402c89a68f resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
34092024-10-31T20:33:20.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2920 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46541 req_id = 4cd359fa-c838-4d36-bb72-73402c89a68f response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
34102024-10-31T20:33:21.160ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 29f71da1-ee0c-40ec-9ab9-81479aeba4c0 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
34112024-10-31T20:33:21.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 29f71da1-ee0c-40ec-9ab9-81479aeba4c0 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
34122024-10-31T20:33:21.163ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2404 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 29f71da1-ee0c-40ec-9ab9-81479aeba4c0 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
34132024-10-31T20:33:22.185ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = e3001245-2860-4df9-9f89-8596d3a90833 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
34142024-10-31T20:33:22.185ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = e3001245-2860-4df9-9f89-8596d3a90833 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
34152024-10-31T20:33:22.187ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2646 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = e3001245-2860-4df9-9f89-8596d3a90833 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
34162024-10-31T20:33:22.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46541 req_id = 8a99cbf4-96b5-4de5-8ea9-e64f49874ca3 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
34172024-10-31T20:33:22.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46541 req_id = 8a99cbf4-96b5-4de5-8ea9-e64f49874ca3 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
34182024-10-31T20:33:22.219ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4264 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46541 req_id = 8a99cbf4-96b5-4de5-8ea9-e64f49874ca3 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
34192024-10-31T20:33:22.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46541 req_id = 6834667f-d301-46b8-99ed-7aeb65a89043 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
34202024-10-31T20:33:22.220ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46541 req_id = 6834667f-d301-46b8-99ed-7aeb65a89043 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
34212024-10-31T20:33:22.223ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3405 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46541 req_id = 6834667f-d301-46b8-99ed-7aeb65a89043 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
34222024-10-31T20:33:23.211ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = dd6acebd-75e5-4fa8-938c-05a6a1c8df16 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
34232024-10-31T20:33:23.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = dd6acebd-75e5-4fa8-938c-05a6a1c8df16 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
34242024-10-31T20:33:23.213ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2522 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = dd6acebd-75e5-4fa8-938c-05a6a1c8df16 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
34252024-10-31T20:33:24.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 931231bc-6e57-4805-bfbc-0aa5c8557a3f roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
34262024-10-31T20:33:24.236ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 931231bc-6e57-4805-bfbc-0aa5c8557a3f resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
34272024-10-31T20:33:24.238ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2404 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 931231bc-6e57-4805-bfbc-0aa5c8557a3f response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
34282024-10-31T20:33:25.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = b22c553e-ad11-46a8-98e4-fcd7264c8dee roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
34292024-10-31T20:33:25.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = b22c553e-ad11-46a8-98e4-fcd7264c8dee resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
34302024-10-31T20:33:25.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2637 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = b22c553e-ad11-46a8-98e4-fcd7264c8dee response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
34312024-10-31T20:33:26.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 1f642acd-2181-4933-b1ec-4023066efa58 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
34322024-10-31T20:33:26.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 1f642acd-2181-4933-b1ec-4023066efa58 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
34332024-10-31T20:33:26.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2213 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 1f642acd-2181-4933-b1ec-4023066efa58 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
34342024-10-31T20:33:27.310ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = d1d256ba-fb65-48bd-a6b3-bada8f729e9b roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
34352024-10-31T20:33:27.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = d1d256ba-fb65-48bd-a6b3-bada8f729e9b resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
34362024-10-31T20:33:27.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2099 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = d1d256ba-fb65-48bd-a6b3-bada8f729e9b response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
34372024-10-31T20:33:28.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 08ac9a0c-94ce-4af9-8ae0-ff77ea104249 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
34382024-10-31T20:33:28.336ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 08ac9a0c-94ce-4af9-8ae0-ff77ea104249 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
34392024-10-31T20:33:28.338ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2283 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 08ac9a0c-94ce-4af9-8ae0-ff77ea104249 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
34402024-10-31T20:33:28.642ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
34412024-10-31T20:33:28.642ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34422024-10-31T20:33:28.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34432024-10-31T20:33:28.642ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
34442024-10-31T20:33:28.642ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34452024-10-31T20:33:28.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34462024-10-31T20:33:28.669ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34472024-10-31T20:33:28.670ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34482024-10-31T20:33:28.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34492024-10-31T20:33:28.672ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34502024-10-31T20:33:28.672ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34512024-10-31T20:33:28.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34522024-10-31T20:33:28.674ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34532024-10-31T20:33:28.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34542024-10-31T20:33:28.700ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.703553ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34552024-10-31T20:33:28.703ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34562024-10-31T20:33:28.705ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 56b527e7-66b3-4602-a305-5dc763e7fb8b, lookup_type: ById(56b527e7-66b3-4602-a305-5dc763e7fb8b) } result = Ok(())
34572024-10-31T20:33:28.705ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34582024-10-31T20:33:28.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34592024-10-31T20:33:28.720ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b original_time_created = 2024-10-31 20:20:56.758465 UTC target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b time_created = 2024-10-31 20:20:56.758465 UTC
34602024-10-31T20:33:28.720ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 78.186382ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"56b527e7-66b3-4602-a305-5dc763e7fb8b","time_created":"2024-10-31T20:20:56.758465Z"}
34612024-10-31T20:33:29.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = bfad338d-9324-4646-ab80-cbd36ce21e4a roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
34622024-10-31T20:33:29.383ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = bfad338d-9324-4646-ab80-cbd36ce21e4a resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
34632024-10-31T20:33:29.385ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2183 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = bfad338d-9324-4646-ab80-cbd36ce21e4a response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
34642024-10-31T20:33:29.533ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = c0830806-a2a5-45b8-9ba4-47136bbb3063 remote_addr = [fd00:1122:3344:101::1]:42412 req_id = e3187f45-a990-443c-8180-fc760572e66c uri = /vmms/c0830806-a2a5-45b8-9ba4-47136bbb3063 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-10-31T20:33:29.532682782Z }
34652024-10-31T20:33:29.533ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42412 req_id = e3187f45-a990-443c-8180-fc760572e66c roles = RoleSet { roles: {} } uri = /vmms/c0830806-a2a5-45b8-9ba4-47136bbb3063
34662024-10-31T20:33:29.533ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42412 req_id = e3187f45-a990-443c-8180-fc760572e66c resource = Database result = Ok(()) uri = /vmms/c0830806-a2a5-45b8-9ba4-47136bbb3063
34672024-10-31T20:33:29.573ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1:0]:34618
34682024-10-31T20:33:29.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:34618 req_id = de54d2e9-30fb-442d-b81a-6e3b3105267a roles = RoleSet { roles: {} } uri = /metrics/producers
34692024-10-31T20:33:29.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:34618 req_id = de54d2e9-30fb-442d-b81a-6e3b3105267a resource = Database result = Ok(()) uri = /metrics/producers
34702024-10-31T20:33:29.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 44499 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42412 req_id = e3187f45-a990-443c-8180-fc760572e66c response_code = 204 uri = /vmms/c0830806-a2a5-45b8-9ba4-47136bbb3063
34712024-10-31T20:33:29.578ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = c0830806-a2a5-45b8-9ba4-47136bbb3063 remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 597ec433-bd5e-419d-a0b8-263bbb64a15c uri = /vmms/c0830806-a2a5-45b8-9ba4-47136bbb3063 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-10-31T20:33:29.578318353Z }
34722024-10-31T20:33:29.578ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 597ec433-bd5e-419d-a0b8-263bbb64a15c roles = RoleSet { roles: {} } uri = /vmms/c0830806-a2a5-45b8-9ba4-47136bbb3063
34732024-10-31T20:33:29.578ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 597ec433-bd5e-419d-a0b8-263bbb64a15c resource = Database result = Ok(()) uri = /vmms/c0830806-a2a5-45b8-9ba4-47136bbb3063
34742024-10-31T20:33:29.610ZINFOnexus: assigned collector to new producer collector_id = 6e71f19b-440f-4a40-bbbb-fa1de5a7e58c file = nexus/src/app/oximeter.rs:76 producer_id = 357fbea1-566f-4f4b-889b-8e19f3822126
34752024-10-31T20:33:29.610ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 36336 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:34618 req_id = de54d2e9-30fb-442d-b81a-6e3b3105267a response_code = 201 uri = /metrics/producers
34762024-10-31T20:33:29.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 38194 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 597ec433-bd5e-419d-a0b8-263bbb64a15c response_code = 204 uri = /vmms/c0830806-a2a5-45b8-9ba4-47136bbb3063
34772024-10-31T20:33:30.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = bef466d6-095d-420e-8ea2-ea0ba9774df1 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
34782024-10-31T20:33:30.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = bef466d6-095d-420e-8ea2-ea0ba9774df1 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
34792024-10-31T20:33:30.409ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2398 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = bef466d6-095d-420e-8ea2-ea0ba9774df1 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
34802024-10-31T20:33:31.431ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = a87f6746-749b-4053-99fe-9292295ddb90 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
34812024-10-31T20:33:31.431ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = a87f6746-749b-4053-99fe-9292295ddb90 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
34822024-10-31T20:33:31.433ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2134 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = a87f6746-749b-4053-99fe-9292295ddb90 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
34832024-10-31T20:33:32.456ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = e11a4996-4f2f-468a-9055-8a8e228252b0 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
34842024-10-31T20:33:32.457ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = e11a4996-4f2f-468a-9055-8a8e228252b0 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
34852024-10-31T20:33:32.458ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1737 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = e11a4996-4f2f-468a-9055-8a8e228252b0 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
34862024-10-31T20:33:32.825ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1450 local_addr = [fd00:1122:3344:101::c]:63183 method = GET remote_addr = [fd00:1122:3344:101::d]:38560 req_id = 325496fd-b8c8-41b0-9afb-43aa85ef9d36 response_code = 200 uri = /d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
34872024-10-31T20:33:33.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 69bec191-7010-4077-9d78-aee9c8616f56 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
34882024-10-31T20:33:33.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 69bec191-7010-4077-9d78-aee9c8616f56 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
34892024-10-31T20:33:33.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2478 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 69bec191-7010-4077-9d78-aee9c8616f56 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
34902024-10-31T20:33:34.509ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = fe0af624-7a15-4f64-bf43-2b7b5a3d5168 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
34912024-10-31T20:33:34.509ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = fe0af624-7a15-4f64-bf43-2b7b5a3d5168 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
34922024-10-31T20:33:34.511ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2602 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = fe0af624-7a15-4f64-bf43-2b7b5a3d5168 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
34932024-10-31T20:33:35.534ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 582f2043-c2c2-4530-b36f-93930649b622 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
34942024-10-31T20:33:35.534ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 582f2043-c2c2-4530-b36f-93930649b622 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
34952024-10-31T20:33:35.537ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2795 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 582f2043-c2c2-4530-b36f-93930649b622 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
34962024-10-31T20:33:36.559ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 9d6dfde9-50db-48a0-af13-fbd3211cbd23 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
34972024-10-31T20:33:36.560ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 9d6dfde9-50db-48a0-af13-fbd3211cbd23 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
34982024-10-31T20:33:36.562ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2377 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 9d6dfde9-50db-48a0-af13-fbd3211cbd23 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
34992024-10-31T20:33:37.582ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 8d491f40-35d1-4f69-a09b-58cbc8114423 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
35002024-10-31T20:33:37.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 8d491f40-35d1-4f69-a09b-58cbc8114423 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
35012024-10-31T20:33:37.584ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2050 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 8d491f40-35d1-4f69-a09b-58cbc8114423 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
35022024-10-31T20:33:37.816ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = 8cfea0aa-33ce-4a5b-8c6e-27a51b23965f roles = RoleSet { roles: {} } uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?sort_by=id_ascending
35032024-10-31T20:33:37.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = 8cfea0aa-33ce-4a5b-8c6e-27a51b23965f resource = Database result = Ok(()) uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?sort_by=id_ascending
35042024-10-31T20:33:37.819ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3178 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = 8cfea0aa-33ce-4a5b-8c6e-27a51b23965f response_code = 200 uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?sort_by=id_ascending
35052024-10-31T20:33:37.819ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = 15c8f710-9b13-4c87-b805-79626edf5a24 roles = RoleSet { roles: {} } uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzA4NDI3Ny1iNmFhLTQ1OWYtOGY4MS1mNGVmNGM3Yzg0M2UifX0%3D
35062024-10-31T20:33:37.819ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = 15c8f710-9b13-4c87-b805-79626edf5a24 resource = Database result = Ok(()) uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzA4NDI3Ny1iNmFhLTQ1OWYtOGY4MS1mNGVmNGM3Yzg0M2UifX0%3D
35072024-10-31T20:33:37.822ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2508 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = 15c8f710-9b13-4c87-b805-79626edf5a24 response_code = 200 uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzA4NDI3Ny1iNmFhLTQ1OWYtOGY4MS1mNGVmNGM3Yzg0M2UifX0%3D
35082024-10-31T20:33:38.606ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 9f9f969c-ad9f-4b9c-86d1-0317c6c5ab8f roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
35092024-10-31T20:33:38.606ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 9f9f969c-ad9f-4b9c-86d1-0317c6c5ab8f resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
35102024-10-31T20:33:38.610ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4586 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 9f9f969c-ad9f-4b9c-86d1-0317c6c5ab8f response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
35112024-10-31T20:33:38.642ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
35122024-10-31T20:33:38.642ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35132024-10-31T20:33:38.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35142024-10-31T20:33:38.642ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
35152024-10-31T20:33:38.642ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35162024-10-31T20:33:38.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35172024-10-31T20:33:38.644ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35182024-10-31T20:33:38.644ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35192024-10-31T20:33:38.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35202024-10-31T20:33:38.647ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
35212024-10-31T20:33:38.647ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35222024-10-31T20:33:38.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35232024-10-31T20:33:38.649ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35242024-10-31T20:33:38.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35252024-10-31T20:33:38.651ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35262024-10-31T20:33:38.653ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 56b527e7-66b3-4602-a305-5dc763e7fb8b, lookup_type: ById(56b527e7-66b3-4602-a305-5dc763e7fb8b) } result = Ok(())
35272024-10-31T20:33:38.653ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35282024-10-31T20:33:38.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35292024-10-31T20:33:38.664ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b original_time_created = 2024-10-31 20:20:56.758465 UTC target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b time_created = 2024-10-31 20:20:56.758465 UTC
35302024-10-31T20:33:38.664ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.694879ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"56b527e7-66b3-4602-a305-5dc763e7fb8b","time_created":"2024-10-31T20:20:56.758465Z"}
35312024-10-31T20:33:38.674ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.992512ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
35322024-10-31T20:33:39.509ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = c0830806-a2a5-45b8-9ba4-47136bbb3063 remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 483fedb1-07f9-4bb2-b49d-b405ee4cc3fa uri = /vmms/c0830806-a2a5-45b8-9ba4-47136bbb3063 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-10-31T20:33:39.509249099Z }
35332024-10-31T20:33:39.509ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 483fedb1-07f9-4bb2-b49d-b405ee4cc3fa roles = RoleSet { roles: {} } uri = /vmms/c0830806-a2a5-45b8-9ba4-47136bbb3063
35342024-10-31T20:33:39.509ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 483fedb1-07f9-4bb2-b49d-b405ee4cc3fa resource = Database result = Ok(()) uri = /vmms/c0830806-a2a5-45b8-9ba4-47136bbb3063
35352024-10-31T20:33:39.526ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 16648 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 483fedb1-07f9-4bb2-b49d-b405ee4cc3fa response_code = 204 uri = /vmms/c0830806-a2a5-45b8-9ba4-47136bbb3063
35362024-10-31T20:33:39.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = ec66741e-2c89-40ef-a6b8-360e3a45a8e2 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
35372024-10-31T20:33:39.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = ec66741e-2c89-40ef-a6b8-360e3a45a8e2 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
35382024-10-31T20:33:39.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1835 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = ec66741e-2c89-40ef-a6b8-360e3a45a8e2 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
35392024-10-31T20:33:40.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46541 req_id = 87498b09-626e-42a8-8ad3-e3457540cae9 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
35402024-10-31T20:33:40.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46541 req_id = 87498b09-626e-42a8-8ad3-e3457540cae9 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
35412024-10-31T20:33:40.248ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 5452 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46541 req_id = 87498b09-626e-42a8-8ad3-e3457540cae9 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
35422024-10-31T20:33:40.250ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46541 req_id = 1eb4d8a4-62c8-4325-8739-6a9962c1c52e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
35432024-10-31T20:33:40.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46541 req_id = 1eb4d8a4-62c8-4325-8739-6a9962c1c52e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
35442024-10-31T20:33:40.253ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3222 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46541 req_id = 1eb4d8a4-62c8-4325-8739-6a9962c1c52e response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
35452024-10-31T20:33:40.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 7bc7c950-73fe-4f08-b935-62d131b2822f roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
35462024-10-31T20:33:40.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 7bc7c950-73fe-4f08-b935-62d131b2822f resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
35472024-10-31T20:33:40.663ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2231 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 7bc7c950-73fe-4f08-b935-62d131b2822f response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
35482024-10-31T20:33:41.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46541 req_id = 81bda249-941d-4bae-929e-f7864420f3a3 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
35492024-10-31T20:33:41.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46541 req_id = 81bda249-941d-4bae-929e-f7864420f3a3 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
35502024-10-31T20:33:41.256ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2847 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46541 req_id = 81bda249-941d-4bae-929e-f7864420f3a3 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
35512024-10-31T20:33:41.683ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 819dde3e-4a2a-49ce-aa87-0774a454048e roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
35522024-10-31T20:33:41.683ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 819dde3e-4a2a-49ce-aa87-0774a454048e resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
35532024-10-31T20:33:41.685ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2448 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 819dde3e-4a2a-49ce-aa87-0774a454048e response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
35542024-10-31T20:33:41.964ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = c0830806-a2a5-45b8-9ba4-47136bbb3063 remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 83682ac8-3dee-4c0b-a744-22c8ff336fdf uri = /vmms/c0830806-a2a5-45b8-9ba4-47136bbb3063 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-10-31T20:33:41.964598693Z }
35552024-10-31T20:33:41.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 83682ac8-3dee-4c0b-a744-22c8ff336fdf roles = RoleSet { roles: {} } uri = /vmms/c0830806-a2a5-45b8-9ba4-47136bbb3063
35562024-10-31T20:33:41.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 83682ac8-3dee-4c0b-a744-22c8ff336fdf resource = Database result = Ok(()) uri = /vmms/c0830806-a2a5-45b8-9ba4-47136bbb3063
35572024-10-31T20:33:41.973ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = c0830806-a2a5-45b8-9ba4-47136bbb3063 remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 83682ac8-3dee-4c0b-a744-22c8ff336fdf uri = /vmms/c0830806-a2a5-45b8-9ba4-47136bbb3063 vmm_needs_update = true
35582024-10-31T20:33:41.973ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 83682ac8-3dee-4c0b-a744-22c8ff336fdf roles = RoleSet { roles: {} } uri = /vmms/c0830806-a2a5-45b8-9ba4-47136bbb3063
35592024-10-31T20:33:41.973ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 83682ac8-3dee-4c0b-a744-22c8ff336fdf resource = Database result = Ok(()) uri = /vmms/c0830806-a2a5-45b8-9ba4-47136bbb3063
35602024-10-31T20:33:41.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 83682ac8-3dee-4c0b-a744-22c8ff336fdf roles = RoleSet { roles: {} } uri = /vmms/c0830806-a2a5-45b8-9ba4-47136bbb3063
35612024-10-31T20:33:41.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 83682ac8-3dee-4c0b-a744-22c8ff336fdf resource = Database result = Ok(()) uri = /vmms/c0830806-a2a5-45b8-9ba4-47136bbb3063
35622024-10-31T20:33:41.980ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 83682ac8-3dee-4c0b-a744-22c8ff336fdf roles = RoleSet { roles: {} } uri = /vmms/c0830806-a2a5-45b8-9ba4-47136bbb3063
35632024-10-31T20:33:41.980ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 83682ac8-3dee-4c0b-a744-22c8ff336fdf resource = Database result = Ok(()) uri = /vmms/c0830806-a2a5-45b8-9ba4-47136bbb3063
35642024-10-31T20:33:41.982ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 83682ac8-3dee-4c0b-a744-22c8ff336fdf roles = RoleSet { roles: {} } uri = /vmms/c0830806-a2a5-45b8-9ba4-47136bbb3063
35652024-10-31T20:33:41.982ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 83682ac8-3dee-4c0b-a744-22c8ff336fdf resource = Database result = Ok(()) uri = /vmms/c0830806-a2a5-45b8-9ba4-47136bbb3063
35662024-10-31T20:33:41.984ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 83682ac8-3dee-4c0b-a744-22c8ff336fdf roles = RoleSet { roles: {} } uri = /vmms/c0830806-a2a5-45b8-9ba4-47136bbb3063
35672024-10-31T20:33:41.984ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 83682ac8-3dee-4c0b-a744-22c8ff336fdf resource = Database result = Ok(()) uri = /vmms/c0830806-a2a5-45b8-9ba4-47136bbb3063
35682024-10-31T20:33:41.986ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 83682ac8-3dee-4c0b-a744-22c8ff336fdf roles = RoleSet { roles: {} } uri = /vmms/c0830806-a2a5-45b8-9ba4-47136bbb3063
35692024-10-31T20:33:41.986ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 83682ac8-3dee-4c0b-a744-22c8ff336fdf resource = Database result = Ok(()) uri = /vmms/c0830806-a2a5-45b8-9ba4-47136bbb3063
35702024-10-31T20:33:41.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 83682ac8-3dee-4c0b-a744-22c8ff336fdf roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/c0830806-a2a5-45b8-9ba4-47136bbb3063
35712024-10-31T20:33:41.990ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 83682ac8-3dee-4c0b-a744-22c8ff336fdf resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 9efc5118-5ea4-4fe1-a8c5-501dee3e98c0, lookup_type: ById(9efc5118-5ea4-4fe1-a8c5-501dee3e98c0) }, key: a417e185-37e9-49d5-8ec8-a866b9e0467f, lookup_type: ById(a417e185-37e9-49d5-8ec8-a866b9e0467f) }, key: 357fbea1-566f-4f4b-889b-8e19f3822126, lookup_type: ById(357fbea1-566f-4f4b-889b-8e19f3822126) } result = Ok(()) uri = /vmms/c0830806-a2a5-45b8-9ba4-47136bbb3063
35722024-10-31T20:33:41.990ZINFOnexus (dropshot_internal): starting update saga for 357fbea1-566f-4f4b-889b-8e19f3822126 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1618 instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 83682ac8-3dee-4c0b-a744-22c8ff336fdf uri = /vmms/c0830806-a2a5-45b8-9ba4-47136bbb3063 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-10-31T20:33:41.964598693Z }
35732024-10-31T20:33:41.990ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 25283 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 83682ac8-3dee-4c0b-a744-22c8ff336fdf response_code = 204 uri = /vmms/c0830806-a2a5-45b8-9ba4-47136bbb3063
35742024-10-31T20:33:41.990ZDEBGnexus (dropshot_internal): preparing instance-update saga for 357fbea1-566f-4f4b-889b-8e19f3822126... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 83682ac8-3dee-4c0b-a744-22c8ff336fdf uri = /vmms/c0830806-a2a5-45b8-9ba4-47136bbb3063
35752024-10-31T20:33:41.990ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 1980ee0e-cedb-4e86-aca7-fad48f4723d0 saga_name = start-instance-update
35762024-10-31T20:33:41.990ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"357fbea1-566f-4f4b-889b-8e19f3822126","lookup_type":{"ById":"357fbea1-566f-4f4b-889b-8e19f3822126"},"parent":{"key":"a417e185-37e9-49d5-8ec8-a866b9e0467f","lookup_type":{"ById":"a417e185-37e9-49d5-8ec8-a866b9e0467f"},"parent":{"key":"9efc5118-5ea4-4fe1-a8c5-501dee3e98c0","lookup_type":{"ById":"9efc5118-5ea4-4fe1-a8c5-501dee3e98c0"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 1980ee0e-cedb-4e86-aca7-fad48f4723d0 saga_name = start-instance-update sec_id = d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
35772024-10-31T20:33:41.990ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 1980ee0e-cedb-4e86-aca7-fad48f4723d0 saga_name = start-instance-update
35782024-10-31T20:33:41.990ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = c0830806-a2a5-45b8-9ba4-47136bbb3063 remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 5e8aa80f-6742-448d-9efa-bc85b5b6871e uri = /vmms/c0830806-a2a5-45b8-9ba4-47136bbb3063 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-10-31T20:33:41.964598693Z }
35792024-10-31T20:33:41.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 5e8aa80f-6742-448d-9efa-bc85b5b6871e roles = RoleSet { roles: {} } uri = /vmms/c0830806-a2a5-45b8-9ba4-47136bbb3063
35802024-10-31T20:33:41.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 5e8aa80f-6742-448d-9efa-bc85b5b6871e resource = Database result = Ok(()) uri = /vmms/c0830806-a2a5-45b8-9ba4-47136bbb3063
35812024-10-31T20:33:41.994ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3829 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 5e8aa80f-6742-448d-9efa-bc85b5b6871e response_code = 204 uri = /vmms/c0830806-a2a5-45b8-9ba4-47136bbb3063
35822024-10-31T20:33:42.020ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 1980ee0e-cedb-4e86-aca7-fad48f4723d0 saga_name = start-instance-update
35832024-10-31T20:33:42.020ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 1980ee0e-cedb-4e86-aca7-fad48f4723d0 saga_name = start-instance-update sec_id = d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
35842024-10-31T20:33:42.020ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
35852024-10-31T20:33:42.020ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 1980ee0e-cedb-4e86-aca7-fad48f4723d0
35862024-10-31T20:33:42.025ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
35872024-10-31T20:33:42.025ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 1980ee0e-cedb-4e86-aca7-fad48f4723d0
35882024-10-31T20:33:42.028ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
35892024-10-31T20:33:42.028ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 1980ee0e-cedb-4e86-aca7-fad48f4723d0
35902024-10-31T20:33:42.031ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
35912024-10-31T20:33:42.031ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("077bd157-97de-47e2-84b2-fc65e0d4fae9")) node_id = 0 saga_id = 1980ee0e-cedb-4e86-aca7-fad48f4723d0
35922024-10-31T20:33:42.034ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
35932024-10-31T20:33:42.034ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 1980ee0e-cedb-4e86-aca7-fad48f4723d0
35942024-10-31T20:33:42.045ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 saga_id = 1980ee0e-cedb-4e86-aca7-fad48f4723d0 saga_name = start-instance-update
35952024-10-31T20:33:42.045ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1980ee0e-cedb-4e86-aca7-fad48f4723d0 saga_name = start-instance-update saga_node = LockInstance
35962024-10-31T20:33:42.045ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1980ee0e-cedb-4e86-aca7-fad48f4723d0 saga_name = start-instance-update saga_node = LockInstance
35972024-10-31T20:33:42.047ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1980ee0e-cedb-4e86-aca7-fad48f4723d0 saga_name = start-instance-update saga_node = LockInstance
35982024-10-31T20:33:42.047ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1980ee0e-cedb-4e86-aca7-fad48f4723d0 saga_name = start-instance-update saga_node = LockInstance
35992024-10-31T20:33:42.049ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1980ee0e-cedb-4e86-aca7-fad48f4723d0 saga_name = start-instance-update saga_node = LockInstance
36002024-10-31T20:33:42.049ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1980ee0e-cedb-4e86-aca7-fad48f4723d0 saga_name = start-instance-update saga_node = LockInstance
36012024-10-31T20:33:42.051ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1980ee0e-cedb-4e86-aca7-fad48f4723d0 saga_name = start-instance-update saga_node = LockInstance
36022024-10-31T20:33:42.051ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1980ee0e-cedb-4e86-aca7-fad48f4723d0 saga_name = start-instance-update saga_node = LockInstance
36032024-10-31T20:33:42.053ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1980ee0e-cedb-4e86-aca7-fad48f4723d0 saga_name = start-instance-update saga_node = LockInstance
36042024-10-31T20:33:42.053ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1980ee0e-cedb-4e86-aca7-fad48f4723d0 saga_name = start-instance-update saga_node = LockInstance
36052024-10-31T20:33:42.054ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1980ee0e-cedb-4e86-aca7-fad48f4723d0 saga_name = start-instance-update saga_node = LockInstance
36062024-10-31T20:33:42.054ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1980ee0e-cedb-4e86-aca7-fad48f4723d0 saga_name = start-instance-update saga_node = LockInstance
36072024-10-31T20:33:42.056ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 1980ee0e-cedb-4e86-aca7-fad48f4723d0 saga_name = start-instance-update saga_node = LockInstance
36082024-10-31T20:33:42.059ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 9efc5118-5ea4-4fe1-a8c5-501dee3e98c0, lookup_type: ById(9efc5118-5ea4-4fe1-a8c5-501dee3e98c0) }, key: a417e185-37e9-49d5-8ec8-a866b9e0467f, lookup_type: ById(a417e185-37e9-49d5-8ec8-a866b9e0467f) }, key: 357fbea1-566f-4f4b-889b-8e19f3822126, lookup_type: ById(357fbea1-566f-4f4b-889b-8e19f3822126) } result = Ok(()) saga_id = 1980ee0e-cedb-4e86-aca7-fad48f4723d0 saga_name = start-instance-update saga_node = LockInstance
36092024-10-31T20:33:42.059ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 saga_id = 1980ee0e-cedb-4e86-aca7-fad48f4723d0 saga_name = start-instance-update saga_node = LockInstance updater_id = 077bd157-97de-47e2-84b2-fc65e0d4fae9
36102024-10-31T20:33:42.059ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1980ee0e-cedb-4e86-aca7-fad48f4723d0 saga_name = start-instance-update saga_node = LockInstance
36112024-10-31T20:33:42.059ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1980ee0e-cedb-4e86-aca7-fad48f4723d0 saga_name = start-instance-update saga_node = LockInstance
36122024-10-31T20:33:42.068ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 saga_id = 1980ee0e-cedb-4e86-aca7-fad48f4723d0 saga_name = start-instance-update saga_node = LockInstance updater_id = 077bd157-97de-47e2-84b2-fc65e0d4fae9
36132024-10-31T20:33:42.068ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1980ee0e-cedb-4e86-aca7-fad48f4723d0 saga_name = start-instance-update saga_node = LockInstance
36142024-10-31T20:33:42.068ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1980ee0e-cedb-4e86-aca7-fad48f4723d0 saga_name = start-instance-update saga_node = LockInstance
36152024-10-31T20:33:42.072ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 locked_gen = Generation(Generation(2)) saga_id = 1980ee0e-cedb-4e86-aca7-fad48f4723d0 saga_name = start-instance-update saga_node = LockInstance updater_id = 077bd157-97de-47e2-84b2-fc65e0d4fae9
36162024-10-31T20:33:42.072ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
36172024-10-31T20:33:42.072ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("077bd157-97de-47e2-84b2-fc65e0d4fae9")}) node_id = 1 saga_id = 1980ee0e-cedb-4e86-aca7-fad48f4723d0
36182024-10-31T20:33:42.075ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
36192024-10-31T20:33:42.075ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 1980ee0e-cedb-4e86-aca7-fad48f4723d0
36202024-10-31T20:33:42.079ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1980ee0e-cedb-4e86-aca7-fad48f4723d0 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
36212024-10-31T20:33:42.079ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1980ee0e-cedb-4e86-aca7-fad48f4723d0 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
36222024-10-31T20:33:42.085ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1980ee0e-cedb-4e86-aca7-fad48f4723d0 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
36232024-10-31T20:33:42.085ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1980ee0e-cedb-4e86-aca7-fad48f4723d0 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
36242024-10-31T20:33:42.086ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1980ee0e-cedb-4e86-aca7-fad48f4723d0 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
36252024-10-31T20:33:42.086ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1980ee0e-cedb-4e86-aca7-fad48f4723d0 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
36262024-10-31T20:33:42.087ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 1980ee0e-cedb-4e86-aca7-fad48f4723d0 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
36272024-10-31T20:33:42.090ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 9efc5118-5ea4-4fe1-a8c5-501dee3e98c0, lookup_type: ById(9efc5118-5ea4-4fe1-a8c5-501dee3e98c0) }, key: a417e185-37e9-49d5-8ec8-a866b9e0467f, lookup_type: ById(a417e185-37e9-49d5-8ec8-a866b9e0467f) }, key: 357fbea1-566f-4f4b-889b-8e19f3822126, lookup_type: ById(357fbea1-566f-4f4b-889b-8e19f3822126) } result = Ok(()) saga_id = 1980ee0e-cedb-4e86-aca7-fad48f4723d0 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
36282024-10-31T20:33:42.090ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1980ee0e-cedb-4e86-aca7-fad48f4723d0 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
36292024-10-31T20:33:42.090ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1980ee0e-cedb-4e86-aca7-fad48f4723d0 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
36302024-10-31T20:33:42.097ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: c0830806-a2a5-45b8-9ba4-47136bbb3063, time_created: 2024-10-31T20:33:21.265036Z, time_deleted: None, instance_id: 357fbea1-566f-4f4b-889b-8e19f3822126, sled_id: 622abb78-eb68-41c1-ac52-e7a263024e57, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-10-31T20:33:41.964598Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-10-31T20:33:18.452750Z, gen: Generation(Generation(3)), propolis_id: Some(c0830806-a2a5-45b8-9ba4-47136bbb3063), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 saga_id = 1980ee0e-cedb-4e86-aca7-fad48f4723d0 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(c0830806-a2a5-45b8-9ba4-47136bbb3063 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-10-31T20:33:42.097031246Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
36312024-10-31T20:33:42.099ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d saga_name = instance-update
36322024-10-31T20:33:42.101ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"357fbea1-566f-4f4b-889b-8e19f3822126","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"c0830806-a2a5-45b8-9ba4-47136bbb3063"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"357fbea1-566f-4f4b-889b-8e19f3822126","lookup_type":{"ById":"357fbea1-566f-4f4b-889b-8e19f3822126"},"parent":{"key":"a417e185-37e9-49d5-8ec8-a866b9e0467f","lookup_type":{"ById":"a417e185-37e9-49d5-8ec8-a866b9e0467f"},"parent":{"key":"9efc5118-5ea4-4fe1-a8c5-501dee3e98c0","lookup_type":{"ById":"9efc5118-5ea4-4fe1-a8c5-501dee3e98c0"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"077bd157-97de-47e2-84b2-fc65e0d4fae9"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"a417e185-37e9-49d5-8ec8-a866b9e0467f","ram_diff":1073741824},"destroy_active_vmm":"c0830806-a2a5-45b8-9ba4-47136bbb3063","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2024-10-31T20:33:42.097031246Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d saga_name = instance-update sec_id = d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
36332024-10-31T20:33:42.102ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d saga_name = instance-update
36342024-10-31T20:33:42.136ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d saga_name = instance-update
36352024-10-31T20:33:42.136ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d saga_name = instance-update sec_id = d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
36362024-10-31T20:33:42.136ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
36372024-10-31T20:33:42.136ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d
36382024-10-31T20:33:42.140ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
36392024-10-31T20:33:42.140ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d
36402024-10-31T20:33:42.143ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
36412024-10-31T20:33:42.143ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d
36422024-10-31T20:33:42.147ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
36432024-10-31T20:33:42.147ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("f12e72a0-ad21-4a0c-8e61-8d6188446da1")) node_id = 0 saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d
36442024-10-31T20:33:42.150ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
36452024-10-31T20:33:42.150ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d
36462024-10-31T20:33:42.153ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 parent_lock = UpdaterLock { updater_id: 077bd157-97de-47e2-84b2-fc65e0d4fae9, locked_gen: Generation(Generation(2)) } saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d saga_name = instance-update
36472024-10-31T20:33:42.153ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d saga_name = instance-update saga_node = BecomeUpdater
36482024-10-31T20:33:42.154ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d saga_name = instance-update saga_node = BecomeUpdater
36492024-10-31T20:33:42.162ZDEBGnexus (SagaExecutor): inherited lock from 077bd157-97de-47e2-84b2-fc65e0d4fae9 to f12e72a0-ad21-4a0c-8e61-8d6188446da1 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = 077bd157-97de-47e2-84b2-fc65e0d4fae9 saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d saga_name = instance-update saga_node = BecomeUpdater updater_id = f12e72a0-ad21-4a0c-8e61-8d6188446da1
36502024-10-31T20:33:42.162ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d saga_name = instance-update
36512024-10-31T20:33:42.162ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
36522024-10-31T20:33:42.162ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("f12e72a0-ad21-4a0c-8e61-8d6188446da1")}) node_id = 1 saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d
36532024-10-31T20:33:42.166ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
36542024-10-31T20:33:42.166ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d
36552024-10-31T20:33:42.169ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
36562024-10-31T20:33:42.169ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d
36572024-10-31T20:33:42.172ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
36582024-10-31T20:33:42.172ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d
36592024-10-31T20:33:42.176ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d saga_name = instance-update
36602024-10-31T20:33:42.176ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126
36612024-10-31T20:33:42.180ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d saga_name = instance-update saga_node = UpdateNetworkConfig
36622024-10-31T20:33:42.180ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d saga_name = instance-update saga_node = UpdateNetworkConfig
36632024-10-31T20:33:42.182ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d saga_name = instance-update saga_node = UpdateNetworkConfig
36642024-10-31T20:33:42.182ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d saga_name = instance-update saga_node = UpdateNetworkConfig
36652024-10-31T20:33:42.187ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
36662024-10-31T20:33:42.187ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d saga_name = instance-update saga_node = UpdateNetworkConfig
36672024-10-31T20:33:42.187ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d saga_name = instance-update saga_node = UpdateNetworkConfig
36682024-10-31T20:33:42.189ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
36692024-10-31T20:33:42.189ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
36702024-10-31T20:33:42.189ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
36712024-10-31T20:33:42.191ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
36722024-10-31T20:33:42.192ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
36732024-10-31T20:33:42.192ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
36742024-10-31T20:33:42.192ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
36752024-10-31T20:33:42.196ZDEBGnexus: notifying dendrite of updates instance_id = Some(357fbea1-566f-4f4b-889b-8e19f3822126 (instance)) switch = switch0
36762024-10-31T20:33:42.197ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1734, tv_nsec: 853256074 } })
36772024-10-31T20:33:42.197ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1114
36782024-10-31T20:33:42.228ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
36792024-10-31T20:33:42.228ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36802024-10-31T20:33:42.228ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac2b8793-2b9e-45a8-a6c1-c0ae7213d010", "content-length": "26", "date": "Thu, 31 Oct 2024 20:33:42 GMT"} })
36812024-10-31T20:33:42.228ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36822024-10-31T20:33:42.229ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
36832024-10-31T20:33:42.258ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
36842024-10-31T20:33:42.258ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "e56a1da5-9760-4ede-9883-8322e5425e72", "content-length": "4", "date": "Thu, 31 Oct 2024 20:33:41 GMT"} })
36852024-10-31T20:33:42.259ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
36862024-10-31T20:33:42.259ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d
36872024-10-31T20:33:42.263ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
36882024-10-31T20:33:42.263ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d
36892024-10-31T20:33:42.266ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d saga_name = instance-update saga_node = ReleaseVirtualProvisioning
36902024-10-31T20:33:42.266ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d saga_name = instance-update saga_node = ReleaseVirtualProvisioning
36912024-10-31T20:33:42.285ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-10-31T20:33:42.269518Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 9efc5118-5ea4-4fe1-a8c5-501dee3e98c0, time_modified: Some(2024-10-31T20:33:42.269518Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: a417e185-37e9-49d5-8ec8-a866b9e0467f, time_modified: Some(2024-10-31T20:33:42.269518Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d saga_name = instance-update
36922024-10-31T20:33:42.285ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
36932024-10-31T20:33:42.285ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d
36942024-10-31T20:33:42.289ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
36952024-10-31T20:33:42.289ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d
36962024-10-31T20:33:42.292ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d saga_name = instance-update
36972024-10-31T20:33:42.292ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d saga_name = instance-update saga_node = UnassignOximeterProducer
36982024-10-31T20:33:42.292ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d saga_name = instance-update saga_node = UnassignOximeterProducer
36992024-10-31T20:33:42.297ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = 6e71f19b-440f-4a40-bbbb-fa1de5a7e58c producer_id = 357fbea1-566f-4f4b-889b-8e19f3822126 saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d saga_name = instance-update
37002024-10-31T20:33:42.297ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d saga_name = instance-update saga_node = UnassignOximeterProducer
37012024-10-31T20:33:42.297ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d saga_name = instance-update saga_node = UnassignOximeterProducer
37022024-10-31T20:33:42.331ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:261 id = 357fbea1-566f-4f4b-889b-8e19f3822126 saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d saga_name = instance-update
37032024-10-31T20:33:42.333ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = 357fbea1-566f-4f4b-889b-8e19f3822126 saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/357fbea1-566f-4f4b-889b-8e19f3822126
37042024-10-31T20:33:42.347ZDEBGnexus (SagaExecutor): client response oximeter-collector = 357fbea1-566f-4f4b-889b-8e19f3822126 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/357fbea1-566f-4f4b-889b-8e19f3822126", status: 204, headers: {"x-request-id": "d4e6b3e9-9364-4fb2-8d75-61c1e10618e2", "date": "Thu, 31 Oct 2024 20:33:42 GMT"} }) saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d saga_name = instance-update
37052024-10-31T20:33:42.347ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = 6e71f19b-440f-4a40-bbbb-fa1de5a7e58c producer_id = 357fbea1-566f-4f4b-889b-8e19f3822126 saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d saga_name = instance-update
37062024-10-31T20:33:42.349ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
37072024-10-31T20:33:42.349ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d
37082024-10-31T20:33:42.352ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
37092024-10-31T20:33:42.352ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d
37102024-10-31T20:33:42.356ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 lock = UpdaterLock { updater_id: f12e72a0-ad21-4a0c-8e61-8d6188446da1, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-10-31T20:33:42.097031246Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d saga_name = instance-update
37112024-10-31T20:33:42.356ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d saga_name = instance-update saga_node = CommitInstanceUpdates
37122024-10-31T20:33:42.356ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d saga_name = instance-update saga_node = CommitInstanceUpdates
37132024-10-31T20:33:42.401ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 new_runtime = InstanceRuntimeState { time_updated: 2024-10-31T20:33:42.097031246Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d saga_name = instance-update
37142024-10-31T20:33:42.401ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
37152024-10-31T20:33:42.401ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d
37162024-10-31T20:33:42.401ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Signaled
37172024-10-31T20:33:42.401ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Signaled
37182024-10-31T20:33:42.401ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
37192024-10-31T20:33:42.401ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37202024-10-31T20:33:42.402ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37212024-10-31T20:33:42.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37222024-10-31T20:33:42.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37232024-10-31T20:33:42.403ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37242024-10-31T20:33:42.405ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
37252024-10-31T20:33:42.405ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37262024-10-31T20:33:42.405ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
37272024-10-31T20:33:42.405ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d
37282024-10-31T20:33:42.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37292024-10-31T20:33:42.407ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37302024-10-31T20:33:42.409ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
37312024-10-31T20:33:42.409ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37322024-10-31T20:33:42.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37332024-10-31T20:33:42.409ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
37342024-10-31T20:33:42.409ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("357fbea1-566f-4f4b-889b-8e19f3822126"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("c0830806-a2a5-45b8-9ba4-47136bbb3063")}) node_id = 7 saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d
37352024-10-31T20:33:42.415ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
37362024-10-31T20:33:42.415ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d
37372024-10-31T20:33:42.419ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
37382024-10-31T20:33:42.419ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d
37392024-10-31T20:33:42.423ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
37402024-10-31T20:33:42.423ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d
37412024-10-31T20:33:42.427ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 propolis_id = c0830806-a2a5-45b8-9ba4-47136bbb3063 saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d saga_name = instance-update
37422024-10-31T20:33:42.427ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d saga_name = instance-update saga_node = ReleaseSledResources
37432024-10-31T20:33:42.427ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d saga_name = instance-update saga_node = ReleaseSledResources
37442024-10-31T20:33:42.440ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
37452024-10-31T20:33:42.440ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d
37462024-10-31T20:33:42.441ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37472024-10-31T20:33:42.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37482024-10-31T20:33:42.444ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
37492024-10-31T20:33:42.444ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d
37502024-10-31T20:33:42.452ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 propolis_id = c0830806-a2a5-45b8-9ba4-47136bbb3063 saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d saga_name = instance-update
37512024-10-31T20:33:42.452ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d saga_name = instance-update saga_node = MarkVmmDeleted
37522024-10-31T20:33:42.452ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d saga_name = instance-update saga_node = MarkVmmDeleted
37532024-10-31T20:33:42.490ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
37542024-10-31T20:33:42.490ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d
37552024-10-31T20:33:42.494ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
37562024-10-31T20:33:42.494ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d
37572024-10-31T20:33:42.497ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
37582024-10-31T20:33:42.497ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d
37592024-10-31T20:33:42.501ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
37602024-10-31T20:33:42.501ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d
37612024-10-31T20:33:42.504ZINFOnexus (BackgroundTasks): VPC route manager sled 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
37622024-10-31T20:33:42.504ZDEBGnexus (BackgroundTasks): client request SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
37632024-10-31T20:33:42.505ZDEBGnexus (BackgroundTasks): client response SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "afaa8b23-201c-43d4-b35d-114b518dc8b1", "content-length": "372", "date": "Thu, 31 Oct 2024 20:33:42 GMT"} })
37642024-10-31T20:33:42.505ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37652024-10-31T20:33:42.505ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d saga_name = instance-update saga_node = ChainSuccessorSaga
37662024-10-31T20:33:42.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37672024-10-31T20:33:42.505ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d saga_name = instance-update saga_node = ChainSuccessorSaga
37682024-10-31T20:33:42.507ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d saga_name = instance-update saga_node = ChainSuccessorSaga
37692024-10-31T20:33:42.507ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d saga_name = instance-update saga_node = ChainSuccessorSaga
37702024-10-31T20:33:42.509ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d saga_name = instance-update saga_node = ChainSuccessorSaga
37712024-10-31T20:33:42.509ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d saga_name = instance-update saga_node = ChainSuccessorSaga
37722024-10-31T20:33:42.540ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37732024-10-31T20:33:42.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37742024-10-31T20:33:42.544ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d saga_name = instance-update saga_node = ChainSuccessorSaga
37752024-10-31T20:33:42.545ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37762024-10-31T20:33:42.548ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 9efc5118-5ea4-4fe1-a8c5-501dee3e98c0, lookup_type: ById(9efc5118-5ea4-4fe1-a8c5-501dee3e98c0) }, key: a417e185-37e9-49d5-8ec8-a866b9e0467f, lookup_type: ById(a417e185-37e9-49d5-8ec8-a866b9e0467f) }, key: 357fbea1-566f-4f4b-889b-8e19f3822126, lookup_type: ById(357fbea1-566f-4f4b-889b-8e19f3822126) } result = Ok(()) saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d saga_name = instance-update saga_node = ChainSuccessorSaga
37772024-10-31T20:33:42.548ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d saga_name = instance-update saga_node = ChainSuccessorSaga
37782024-10-31T20:33:42.548ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d saga_name = instance-update saga_node = ChainSuccessorSaga
37792024-10-31T20:33:42.549ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
37802024-10-31T20:33:42.549ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37812024-10-31T20:33:42.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37822024-10-31T20:33:42.550ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
37832024-10-31T20:33:42.550ZDEBGnexus (BackgroundTasks): client request SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
37842024-10-31T20:33:42.551ZDEBGnexus (BackgroundTasks): client response SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "acbb66f5-ac23-4d20-bcad-c476812e7162", "date": "Thu, 31 Oct 2024 20:33:42 GMT"} })
37852024-10-31T20:33:42.551ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37862024-10-31T20:33:42.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37872024-10-31T20:33:42.551ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37882024-10-31T20:33:42.553ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
37892024-10-31T20:33:42.553ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37902024-10-31T20:33:42.553ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37912024-10-31T20:33:42.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37922024-10-31T20:33:42.553ZDEBGnexus (SagaExecutor): instance update: instance will not reincarnate auto_restart_config = InstanceAutoRestart { policy: None, cooldown: None } instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 karmic_state = WillReincarnate needs_reincarnation = false saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d saga_name = instance-update
37932024-10-31T20:33:42.553ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
37942024-10-31T20:33:42.553ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d
37952024-10-31T20:33:42.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37962024-10-31T20:33:42.556ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37972024-10-31T20:33:42.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37982024-10-31T20:33:42.558ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
37992024-10-31T20:33:42.558ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d
38002024-10-31T20:33:42.560ZINFOnexus (BackgroundTasks): VPC route manager sled 622abb78-eb68-41c1-ac52-e7a263024e57 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
38012024-10-31T20:33:42.560ZDEBGnexus (BackgroundTasks): client request SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
38022024-10-31T20:33:42.560ZDEBGnexus (BackgroundTasks): client response SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "dac923e2-16e1-4363-bca9-5c2347d168cb", "date": "Thu, 31 Oct 2024 20:33:42 GMT"} })
38032024-10-31T20:33:42.561ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
38042024-10-31T20:33:42.561ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d
38052024-10-31T20:33:42.562ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 160.042288ms iteration = 27 status = {}
38062024-10-31T20:33:42.586ZDEBGnexus (BackgroundTasks): client request SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
38072024-10-31T20:33:42.587ZDEBGnexus (BackgroundTasks): client response SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "176e1c38-e6d4-4ec0-bb8b-e9869e93f6b7", "content-length": "691", "date": "Thu, 31 Oct 2024 20:33:42 GMT"} })
38082024-10-31T20:33:42.587ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
38092024-10-31T20:33:42.587ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
38102024-10-31T20:33:42.587ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
38112024-10-31T20:33:42.587ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 185.80047ms iteration = 26 status = {}
38122024-10-31T20:33:42.590ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d sec_id = d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
38132024-10-31T20:33:42.590ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d
38142024-10-31T20:33:42.597ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d saga_name = instance-update sec_id = d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
38152024-10-31T20:33:42.597ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d saga_name = instance-update saga_result = SagaResult { saga_id: 6d764091-3c31-4153-b3d8-b387fc760a4d, saga_log: SagaLog { saga_id: 6d764091-3c31-4153-b3d8-b387fc760a4d, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("f12e72a0-ad21-4a0c-8e61-8d6188446da1")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("f12e72a0-ad21-4a0c-8e61-8d6188446da1")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("357fbea1-566f-4f4b-889b-8e19f3822126"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("c0830806-a2a5-45b8-9ba4-47136bbb3063")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("357fbea1-566f-4f4b-889b-8e19f3822126"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("c0830806-a2a5-45b8-9ba4-47136bbb3063")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("f12e72a0-ad21-4a0c-8e61-8d6188446da1"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("f12e72a0-ad21-4a0c-8e61-8d6188446da1")}} }) }
38162024-10-31T20:33:42.597ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = 6d764091-3c31-4153-b3d8-b387fc760a4d instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 saga_id = 1980ee0e-cedb-4e86-aca7-fad48f4723d0 saga_name = start-instance-update
38172024-10-31T20:33:42.597ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
38182024-10-31T20:33:42.597ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 1980ee0e-cedb-4e86-aca7-fad48f4723d0
38192024-10-31T20:33:42.601ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
38202024-10-31T20:33:42.601ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 1980ee0e-cedb-4e86-aca7-fad48f4723d0
38212024-10-31T20:33:42.604ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
38222024-10-31T20:33:42.604ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 1980ee0e-cedb-4e86-aca7-fad48f4723d0
38232024-10-31T20:33:42.607ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 1980ee0e-cedb-4e86-aca7-fad48f4723d0 sec_id = d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
38242024-10-31T20:33:42.607ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 1980ee0e-cedb-4e86-aca7-fad48f4723d0
38252024-10-31T20:33:42.613ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 1980ee0e-cedb-4e86-aca7-fad48f4723d0 saga_name = start-instance-update sec_id = d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
38262024-10-31T20:33:42.613ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 1980ee0e-cedb-4e86-aca7-fad48f4723d0 saga_name = start-instance-update saga_result = SagaResult { saga_id: 1980ee0e-cedb-4e86-aca7-fad48f4723d0, saga_log: SagaLog { saga_id: 1980ee0e-cedb-4e86-aca7-fad48f4723d0, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("077bd157-97de-47e2-84b2-fc65e0d4fae9")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("077bd157-97de-47e2-84b2-fc65e0d4fae9")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("077bd157-97de-47e2-84b2-fc65e0d4fae9"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("077bd157-97de-47e2-84b2-fc65e0d4fae9")}} }) }
38272024-10-31T20:33:42.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = d998104b-7b78-4a75-954f-914635cadfb8 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
38282024-10-31T20:33:42.708ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = d998104b-7b78-4a75-954f-914635cadfb8 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
38292024-10-31T20:33:42.710ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1611 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = d998104b-7b78-4a75-954f-914635cadfb8 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
38302024-10-31T20:33:43.259ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46541 req_id = 1df479b2-47fc-47b1-96b9-759bae490c97 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
38312024-10-31T20:33:43.259ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46541 req_id = 1df479b2-47fc-47b1-96b9-759bae490c97 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
38322024-10-31T20:33:43.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3162 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46541 req_id = 1df479b2-47fc-47b1-96b9-759bae490c97 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
38332024-10-31T20:33:43.732ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 93062cb8-4519-4923-b2e2-ea6fbbc0a5e3 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
38342024-10-31T20:33:43.733ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 93062cb8-4519-4923-b2e2-ea6fbbc0a5e3 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
38352024-10-31T20:33:43.734ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1793 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 93062cb8-4519-4923-b2e2-ea6fbbc0a5e3 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
38362024-10-31T20:33:44.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46541 req_id = 62014793-7ed0-43cb-a9d4-f5ef720ad477 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
38372024-10-31T20:33:44.264ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46541 req_id = 62014793-7ed0-43cb-a9d4-f5ef720ad477 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
38382024-10-31T20:33:44.267ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3222 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46541 req_id = 62014793-7ed0-43cb-a9d4-f5ef720ad477 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
38392024-10-31T20:33:44.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 9a1260fc-e542-4261-bee5-5bc4535fb7c9 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
38402024-10-31T20:33:44.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 9a1260fc-e542-4261-bee5-5bc4535fb7c9 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
38412024-10-31T20:33:44.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2329 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 9a1260fc-e542-4261-bee5-5bc4535fb7c9 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
38422024-10-31T20:33:45.784ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 334d96ca-1434-4124-b77d-92a328ff5b5a roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
38432024-10-31T20:33:45.784ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 334d96ca-1434-4124-b77d-92a328ff5b5a resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
38442024-10-31T20:33:45.785ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1805 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 334d96ca-1434-4124-b77d-92a328ff5b5a response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
38452024-10-31T20:33:46.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = fa04d346-5144-4935-9602-5f56e48c3324 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
38462024-10-31T20:33:46.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = fa04d346-5144-4935-9602-5f56e48c3324 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
38472024-10-31T20:33:46.810ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2662 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = fa04d346-5144-4935-9602-5f56e48c3324 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
38482024-10-31T20:33:47.825ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1885 local_addr = [fd00:1122:3344:101::c]:63183 method = GET remote_addr = [fd00:1122:3344:101::d]:38560 req_id = 1ce609f9-868b-4edc-a483-3531219461bd response_code = 200 uri = /d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
38492024-10-31T20:33:47.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = b6e04d2f-ebb5-417d-b023-6985f6b0bd41 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
38502024-10-31T20:33:47.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = b6e04d2f-ebb5-417d-b023-6985f6b0bd41 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
38512024-10-31T20:33:47.836ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2499 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = b6e04d2f-ebb5-417d-b023-6985f6b0bd41 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
38522024-10-31T20:33:48.642ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
38532024-10-31T20:33:48.642ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38542024-10-31T20:33:48.642ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
38552024-10-31T20:33:48.642ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
38562024-10-31T20:33:48.642ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38572024-10-31T20:33:48.642ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
38582024-10-31T20:33:48.642ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38592024-10-31T20:33:48.642ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
38602024-10-31T20:33:48.642ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
38612024-10-31T20:33:48.642ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
38622024-10-31T20:33:48.642ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
38632024-10-31T20:33:48.642ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
38642024-10-31T20:33:48.642ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
38652024-10-31T20:33:48.642ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38662024-10-31T20:33:48.642ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
38672024-10-31T20:33:48.642ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38682024-10-31T20:33:48.642ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
38692024-10-31T20:33:48.642ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
38702024-10-31T20:33:48.642ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
38712024-10-31T20:33:48.642ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
38722024-10-31T20:33:48.642ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
38732024-10-31T20:33:48.642ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38742024-10-31T20:33:48.642ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
38752024-10-31T20:33:48.642ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38762024-10-31T20:33:48.642ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
38772024-10-31T20:33:48.642ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 10.01\u{b5}s iteration = 26 status = {"errors":[],"records_set_to_done":[]}
38782024-10-31T20:33:48.642ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
38792024-10-31T20:33:48.642ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
38802024-10-31T20:33:48.642ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 5.13\u{b5}s iteration = 26 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
38812024-10-31T20:33:48.642ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
38822024-10-31T20:33:48.642ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
38832024-10-31T20:33:48.642ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
38842024-10-31T20:33:48.642ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 4.97\u{b5}s iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
38852024-10-31T20:33:48.642ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
38862024-10-31T20:33:48.642ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 7.38\u{b5}s iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
38872024-10-31T20:33:48.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38882024-10-31T20:33:48.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
38892024-10-31T20:33:48.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
38902024-10-31T20:33:48.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38912024-10-31T20:33:48.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38922024-10-31T20:33:48.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38932024-10-31T20:33:48.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38942024-10-31T20:33:48.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38952024-10-31T20:33:48.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
38962024-10-31T20:33:48.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
38972024-10-31T20:33:48.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
38982024-10-31T20:33:48.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38992024-10-31T20:33:48.644ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39002024-10-31T20:33:48.645ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.339709ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
39012024-10-31T20:33:48.646ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1741, tv_nsec: 302412147 } })
39022024-10-31T20:33:48.646ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39032024-10-31T20:33:48.646ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
39042024-10-31T20:33:48.647ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
39052024-10-31T20:33:48.647ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39062024-10-31T20:33:48.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39072024-10-31T20:33:48.649ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
39082024-10-31T20:33:48.649ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39092024-10-31T20:33:48.649ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39102024-10-31T20:33:48.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39112024-10-31T20:33:48.652ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39122024-10-31T20:33:48.652ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39132024-10-31T20:33:48.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39142024-10-31T20:33:48.652ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1741, tv_nsec: 308828000 } })
39152024-10-31T20:33:48.653ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
39162024-10-31T20:33:48.655ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39172024-10-31T20:33:48.655ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39182024-10-31T20:33:48.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39192024-10-31T20:33:48.655ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1741, tv_nsec: 311419575 } })
39202024-10-31T20:33:48.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39212024-10-31T20:33:48.655ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439
39222024-10-31T20:33:48.681ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39232024-10-31T20:33:48.684ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
39242024-10-31T20:33:48.684ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39252024-10-31T20:33:48.684ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39262024-10-31T20:33:48.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39272024-10-31T20:33:48.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39282024-10-31T20:33:48.685ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
39292024-10-31T20:33:48.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
39302024-10-31T20:33:48.687ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 44.507881ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39312024-10-31T20:33:48.687ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39322024-10-31T20:33:48.687ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39332024-10-31T20:33:48.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39342024-10-31T20:33:48.688ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39352024-10-31T20:33:48.688ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
39362024-10-31T20:33:48.688ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39372024-10-31T20:33:48.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39382024-10-31T20:33:48.689ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39392024-10-31T20:33:48.689ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39402024-10-31T20:33:48.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39412024-10-31T20:33:48.690ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39422024-10-31T20:33:48.690ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39432024-10-31T20:33:48.691ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39442024-10-31T20:33:48.691ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39452024-10-31T20:33:48.691ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
39462024-10-31T20:33:48.691ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39472024-10-31T20:33:48.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39482024-10-31T20:33:48.693ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
39492024-10-31T20:33:48.693ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
39502024-10-31T20:33:48.693ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
39512024-10-31T20:33:48.693ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39522024-10-31T20:33:48.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
39532024-10-31T20:33:48.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39542024-10-31T20:33:48.693ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39552024-10-31T20:33:48.693ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39562024-10-31T20:33:48.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39572024-10-31T20:33:48.696ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39582024-10-31T20:33:48.699ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 56b527e7-66b3-4602-a305-5dc763e7fb8b, lookup_type: ById(56b527e7-66b3-4602-a305-5dc763e7fb8b) } result = Ok(())
39592024-10-31T20:33:48.699ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39602024-10-31T20:33:48.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39612024-10-31T20:33:48.707ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b original_time_created = 2024-10-31 20:20:56.758465 UTC target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b time_created = 2024-10-31 20:20:56.758465 UTC
39622024-10-31T20:33:48.707ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 65.56691ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"56b527e7-66b3-4602-a305-5dc763e7fb8b","time_created":"2024-10-31T20:20:56.758465Z"}
39632024-10-31T20:33:48.708ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39642024-10-31T20:33:48.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39652024-10-31T20:33:48.710ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39662024-10-31T20:33:48.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39672024-10-31T20:33:48.712ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39682024-10-31T20:33:48.715ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 72.666145ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
39692024-10-31T20:33:48.715ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 622abb78-eb68-41c1-ac52-e7a263024e57, lookup_type: ById(622abb78-eb68-41c1-ac52-e7a263024e57) } result = Ok(())
39702024-10-31T20:33:48.715ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39712024-10-31T20:33:48.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39722024-10-31T20:33:48.718ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
39732024-10-31T20:33:48.718ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
39742024-10-31T20:33:48.718ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5f6e3c11-a90f-4974-ac1a-5a54279082c9", "content-length": "26", "date": "Thu, 31 Oct 2024 20:33:48 GMT"} })
39752024-10-31T20:33:48.718ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
39762024-10-31T20:33:48.719ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
39772024-10-31T20:33:48.720ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 77.686623ms iteration = 26 status = 0
39782024-10-31T20:33:48.725ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39792024-10-31T20:33:48.725ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
39802024-10-31T20:33:48.725ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 82.64213ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
39812024-10-31T20:33:48.726ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
39822024-10-31T20:33:48.726ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
39832024-10-31T20:33:48.727ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae382722-b145-4206-ab19-46312e4cc21a", "content-length": "26", "date": "Thu, 31 Oct 2024 20:33:48 GMT"} })
39842024-10-31T20:33:48.727ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
39852024-10-31T20:33:48.729ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
39862024-10-31T20:33:48.734ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
39872024-10-31T20:33:48.734ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 91.883762ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
39882024-10-31T20:33:48.744ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 zone_address = fd00:1122:3344:101::2
39892024-10-31T20:33:48.744ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
39902024-10-31T20:33:48.744ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "756926d1-d899-4457-bb80-ce8f560364ed", "content-length": "26", "date": "Thu, 31 Oct 2024 20:33:48 GMT"} })
39912024-10-31T20:33:48.744ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
39922024-10-31T20:33:48.746ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439
39932024-10-31T20:33:48.751ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39942024-10-31T20:33:48.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39952024-10-31T20:33:48.758ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39962024-10-31T20:33:48.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39972024-10-31T20:33:48.760ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39982024-10-31T20:33:48.762ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
39992024-10-31T20:33:48.762ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40002024-10-31T20:33:48.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40012024-10-31T20:33:48.764ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40022024-10-31T20:33:48.766ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
40032024-10-31T20:33:48.766ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40042024-10-31T20:33:48.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40052024-10-31T20:33:48.787ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 144.893443ms iteration = 30 status = {"physical_disks_added":0}
40062024-10-31T20:33:48.822ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
40072024-10-31T20:33:48.823ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "df4357c2-b111-4bbb-884a-d75a42aae293", "content-length": "2", "date": "Thu, 31 Oct 2024 20:33:47 GMT"} })
40082024-10-31T20:33:48.824ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
40092024-10-31T20:33:48.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
40102024-10-31T20:33:48.835ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 193.290672ms iteration = 26 status = {}
40112024-10-31T20:33:48.858ZINFOnexus (BackgroundTasks): VPC route manager sled 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
40122024-10-31T20:33:48.858ZDEBGnexus (BackgroundTasks): client request SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
40132024-10-31T20:33:48.858ZDEBGnexus (BackgroundTasks): client response SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "438339cf-6c5e-42b8-9922-626543cfb59a", "content-length": "372", "date": "Thu, 31 Oct 2024 20:33:48 GMT"} })
40142024-10-31T20:33:48.858ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40152024-10-31T20:33:48.859ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 01aa8381-ff2c-4f6d-9aa9-ddc51804a62d roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
40162024-10-31T20:33:48.859ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 01aa8381-ff2c-4f6d-9aa9-ddc51804a62d resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
40172024-10-31T20:33:48.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40182024-10-31T20:33:48.861ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 219.122825ms iteration = 26 status = null
40192024-10-31T20:33:48.862ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2913 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 01aa8381-ff2c-4f6d-9aa9-ddc51804a62d response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
40202024-10-31T20:33:48.910ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
40212024-10-31T20:33:48.910ZDEBGnexus (BackgroundTasks): client request SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
40222024-10-31T20:33:48.910ZDEBGnexus (BackgroundTasks): client response SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "33386998-57be-4e8b-b5bf-b388c7873c9a", "date": "Thu, 31 Oct 2024 20:33:48 GMT"} })
40232024-10-31T20:33:48.910ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40242024-10-31T20:33:48.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40252024-10-31T20:33:48.913ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40262024-10-31T20:33:48.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40272024-10-31T20:33:48.916ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40282024-10-31T20:33:48.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40292024-10-31T20:33:48.919ZINFOnexus (BackgroundTasks): VPC route manager sled 622abb78-eb68-41c1-ac52-e7a263024e57 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
40302024-10-31T20:33:48.919ZDEBGnexus (BackgroundTasks): client request SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
40312024-10-31T20:33:48.920ZDEBGnexus (BackgroundTasks): client response SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "4b8bd3da-bbf9-4781-a3f5-e42508740acc", "date": "Thu, 31 Oct 2024 20:33:48 GMT"} })
40322024-10-31T20:33:48.922ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 279.567585ms iteration = 28 status = {}
40332024-10-31T20:33:48.943ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40342024-10-31T20:33:48.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40352024-10-31T20:33:48.945ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2c0ce4ae-e332-4e80-bd64-c2d6cfd99f8f, rack_id: cf9a2d24-88ed-47a2-a402-0cbbba2d1439, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(1479dccf-28ea-4cc0-9964-818390bddf17) } rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 switch_location = Switch0
40362024-10-31T20:33:48.945ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40372024-10-31T20:33:48.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40382024-10-31T20:33:48.955ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
40392024-10-31T20:33:48.955ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "77c909ba-9414-4609-8aff-67637dd22506", "content-length": "121", "date": "Thu, 31 Oct 2024 20:33:48 GMT"} })
40402024-10-31T20:33:48.955ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
40412024-10-31T20:33:48.955ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 1479dccf-28ea-4cc0-9964-818390bddf17
40422024-10-31T20:33:48.956ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
40432024-10-31T20:33:48.956ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
40442024-10-31T20:33:48.956ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
40452024-10-31T20:33:48.956ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
40462024-10-31T20:33:48.956ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
40472024-10-31T20:33:48.956ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
40482024-10-31T20:33:48.956ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
40492024-10-31T20:33:48.956ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
40502024-10-31T20:33:48.956ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439
40512024-10-31T20:33:48.956ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40522024-10-31T20:33:48.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40532024-10-31T20:33:48.958ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
40542024-10-31T20:33:48.958ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "f00d8019-8035-43ae-a69d-ad6b54940ff8", "content-length": "2", "date": "Thu, 31 Oct 2024 20:33:48 GMT"} })
40552024-10-31T20:33:48.958ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
40562024-10-31T20:33:48.958ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a40a16e-545f-4c4d-9964-69043972616d", "content-length": "52", "date": "Thu, 31 Oct 2024 20:33:48 GMT"} })
40572024-10-31T20:33:48.958ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 switch_location = Switch0
40582024-10-31T20:33:48.958ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
40592024-10-31T20:33:48.972ZDEBGnexus (BackgroundTasks): client request SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
40602024-10-31T20:33:49.091ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "8a0a7e73-6152-49c9-bb8c-a676aafb461a", "date": "Thu, 31 Oct 2024 20:33:48 GMT"} })
40612024-10-31T20:33:49.091ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 switch = Switch0
40622024-10-31T20:33:49.091ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
40632024-10-31T20:33:49.091ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0bb092f7-0d30-4838-8768-d683552f5927", "content-length": "669", "date": "Thu, 31 Oct 2024 20:33:48 GMT"} })
40642024-10-31T20:33:49.091ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40652024-10-31T20:33:49.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40662024-10-31T20:33:49.095ZDEBGnexus (BackgroundTasks): client response SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4392e846-ad9f-4188-97b5-b4c92aae7f54", "content-length": "691", "date": "Thu, 31 Oct 2024 20:33:49 GMT"} })
40672024-10-31T20:33:49.095ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
40682024-10-31T20:33:49.095ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
40692024-10-31T20:33:49.095ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
40702024-10-31T20:33:49.097ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 455.108356ms iteration = 27 status = {}
40712024-10-31T20:33:49.099ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40722024-10-31T20:33:49.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40732024-10-31T20:33:49.103ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40742024-10-31T20:33:49.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40752024-10-31T20:33:49.106ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40762024-10-31T20:33:49.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40772024-10-31T20:33:49.117ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 475.627586ms iteration = 26 status = {}
40782024-10-31T20:33:49.320ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:33636
40792024-10-31T20:33:49.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33636 req_id = a14750b2-3f1d-43d8-8913-97e38788c3a5 roles = RoleSet { roles: {} } uri = /metrics/producers
40802024-10-31T20:33:49.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33636 req_id = a14750b2-3f1d-43d8-8913-97e38788c3a5 resource = Database result = Ok(()) uri = /metrics/producers
40812024-10-31T20:33:49.358ZINFOnexus: assigned collector to new producer collector_id = 6e71f19b-440f-4a40-bbbb-fa1de5a7e58c file = nexus/src/app/oximeter.rs:76 producer_id = 8e92f635-c267-4817-ab48-5ce3a797cb1d
40822024-10-31T20:33:49.358ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 38161 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33636 req_id = a14750b2-3f1d-43d8-8913-97e38788c3a5 response_code = 201 uri = /metrics/producers
40832024-10-31T20:33:49.889ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 0067b243-0cf1-4ab0-bc78-0c187c8f49f6 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
40842024-10-31T20:33:49.889ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 0067b243-0cf1-4ab0-bc78-0c187c8f49f6 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
40852024-10-31T20:33:49.891ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2543 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 0067b243-0cf1-4ab0-bc78-0c187c8f49f6 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
40862024-10-31T20:33:50.914ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 31d65799-b21d-4561-8933-c76071dfe901 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
40872024-10-31T20:33:50.914ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 31d65799-b21d-4561-8933-c76071dfe901 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
40882024-10-31T20:33:50.916ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2418 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 31d65799-b21d-4561-8933-c76071dfe901 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
40892024-10-31T20:33:51.938ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = a8430e7f-d6c7-41da-b7d4-d009d2099316 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
40902024-10-31T20:33:51.939ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = a8430e7f-d6c7-41da-b7d4-d009d2099316 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
40912024-10-31T20:33:51.940ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2046 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = a8430e7f-d6c7-41da-b7d4-d009d2099316 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
40922024-10-31T20:33:52.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = b69407f0-4e52-45e1-9229-aa8a8f7db814 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
40932024-10-31T20:33:52.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = b69407f0-4e52-45e1-9229-aa8a8f7db814 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
40942024-10-31T20:33:52.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2696 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = b69407f0-4e52-45e1-9229-aa8a8f7db814 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
40952024-10-31T20:33:53.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = ce6bae89-628a-4252-96e0-0516f71a4589 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
40962024-10-31T20:33:53.987ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = ce6bae89-628a-4252-96e0-0516f71a4589 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
40972024-10-31T20:33:53.989ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2515 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = ce6bae89-628a-4252-96e0-0516f71a4589 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
40982024-10-31T20:33:54.151ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
40992024-10-31T20:33:54.151ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
41002024-10-31T20:33:54.182ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
41012024-10-31T20:33:54.182ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:37837
41022024-10-31T20:33:54.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:37837 req_id = d2ae17a4-052b-49d4-84cc-7f9d6459c3e1 roles = RoleSet { roles: {} } uri = /metrics/producers
41032024-10-31T20:33:54.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:37837 req_id = d2ae17a4-052b-49d4-84cc-7f9d6459c3e1 resource = Database result = Ok(()) uri = /metrics/producers
41042024-10-31T20:33:54.217ZINFOnexus: assigned collector to new producer collector_id = 6e71f19b-440f-4a40-bbbb-fa1de5a7e58c file = nexus/src/app/oximeter.rs:76 producer_id = d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
41052024-10-31T20:33:54.217ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 34452 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:37837 req_id = d2ae17a4-052b-49d4-84cc-7f9d6459c3e1 response_code = 201 uri = /metrics/producers
41062024-10-31T20:33:54.217ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "d2ae17a4-052b-49d4-84cc-7f9d6459c3e1", "content-length": "41", "date": "Thu, 31 Oct 2024 20:33:54 GMT"} })
41072024-10-31T20:33:54.219ZDEBGnexus (producer-registration-task): registered with nexus successfully
41082024-10-31T20:33:54.219ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
41092024-10-31T20:33:55.011ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = df05d673-272f-4580-999e-42a500f23005 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
41102024-10-31T20:33:55.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = df05d673-272f-4580-999e-42a500f23005 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
41112024-10-31T20:33:55.014ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2622 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = df05d673-272f-4580-999e-42a500f23005 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
41122024-10-31T20:33:56.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = cebf32ff-102b-48db-b72d-57174a52ea75 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
41132024-10-31T20:33:56.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = cebf32ff-102b-48db-b72d-57174a52ea75 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
41142024-10-31T20:33:56.037ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2209 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = cebf32ff-102b-48db-b72d-57174a52ea75 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
41152024-10-31T20:33:57.058ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 58469f22-68be-4bb2-9f3a-5c8799dba266 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
41162024-10-31T20:33:57.058ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 58469f22-68be-4bb2-9f3a-5c8799dba266 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
41172024-10-31T20:33:57.060ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2473 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 58469f22-68be-4bb2-9f3a-5c8799dba266 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
41182024-10-31T20:33:58.081ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 4dd1a251-dc30-4cfb-b0eb-768211245da5 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
41192024-10-31T20:33:58.081ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 4dd1a251-dc30-4cfb-b0eb-768211245da5 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
41202024-10-31T20:33:58.083ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2071 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 4dd1a251-dc30-4cfb-b0eb-768211245da5 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
41212024-10-31T20:33:58.642ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
41222024-10-31T20:33:58.642ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
41232024-10-31T20:33:58.642ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41242024-10-31T20:33:58.642ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41252024-10-31T20:33:58.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41262024-10-31T20:33:58.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41272024-10-31T20:33:58.670ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41282024-10-31T20:33:58.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41292024-10-31T20:33:58.672ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41302024-10-31T20:33:58.675ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
41312024-10-31T20:33:58.675ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41322024-10-31T20:33:58.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41332024-10-31T20:33:58.678ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41342024-10-31T20:33:58.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41352024-10-31T20:33:58.679ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41362024-10-31T20:33:58.682ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 56b527e7-66b3-4602-a305-5dc763e7fb8b, lookup_type: ById(56b527e7-66b3-4602-a305-5dc763e7fb8b) } result = Ok(())
41372024-10-31T20:33:58.682ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41382024-10-31T20:33:58.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41392024-10-31T20:33:58.693ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b original_time_created = 2024-10-31 20:20:56.758465 UTC target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b time_created = 2024-10-31 20:20:56.758465 UTC
41402024-10-31T20:33:58.693ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 51.381141ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"56b527e7-66b3-4602-a305-5dc763e7fb8b","time_created":"2024-10-31T20:20:56.758465Z"}
41412024-10-31T20:33:58.700ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.991888ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
41422024-10-31T20:33:59.105ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 3269741c-6fcc-4986-98c0-9c4dd1f6cac9 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
41432024-10-31T20:33:59.106ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 3269741c-6fcc-4986-98c0-9c4dd1f6cac9 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
41442024-10-31T20:33:59.107ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1706 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 3269741c-6fcc-4986-98c0-9c4dd1f6cac9 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
41452024-10-31T20:33:59.711ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:49435
41462024-10-31T20:33:59.711ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:49435 req_id = 5a54b6b7-b3ad-41ce-b090-8198670b6c2e roles = RoleSet { roles: {} } uri = /metrics/producers
41472024-10-31T20:33:59.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:49435 req_id = 5a54b6b7-b3ad-41ce-b090-8198670b6c2e resource = Database result = Ok(()) uri = /metrics/producers
41482024-10-31T20:33:59.752ZINFOnexus: assigned collector to new producer collector_id = 6e71f19b-440f-4a40-bbbb-fa1de5a7e58c file = nexus/src/app/oximeter.rs:76 producer_id = 443ed735-d897-4113-ac28-5f8cde119db0
41492024-10-31T20:33:59.752ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 40694 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:49435 req_id = 5a54b6b7-b3ad-41ce-b090-8198670b6c2e response_code = 201 uri = /metrics/producers
41502024-10-31T20:34:00.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 9e65c905-3caa-4b2b-8723-146101a153ef roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
41512024-10-31T20:34:00.130ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 9e65c905-3caa-4b2b-8723-146101a153ef resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
41522024-10-31T20:34:00.132ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2295 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 9e65c905-3caa-4b2b-8723-146101a153ef response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
41532024-10-31T20:34:01.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 4624f54b-c4e0-43ce-a802-5e962e4e8054 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
41542024-10-31T20:34:01.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 4624f54b-c4e0-43ce-a802-5e962e4e8054 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
41552024-10-31T20:34:01.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2155 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 4624f54b-c4e0-43ce-a802-5e962e4e8054 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
41562024-10-31T20:34:02.177ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 54cf9083-490d-4141-8385-1e0da32e388f roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
41572024-10-31T20:34:02.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 54cf9083-490d-4141-8385-1e0da32e388f resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
41582024-10-31T20:34:02.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2287 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 54cf9083-490d-4141-8385-1e0da32e388f response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
41592024-10-31T20:34:02.826ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1720 local_addr = [fd00:1122:3344:101::c]:63183 method = GET remote_addr = [fd00:1122:3344:101::d]:38560 req_id = d72f90fc-cdb5-46a8-b90c-14691f941a96 response_code = 200 uri = /d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
41602024-10-31T20:34:03.201ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 4203e5e2-66db-4d52-a05b-7b79bf148749 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
41612024-10-31T20:34:03.201ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 4203e5e2-66db-4d52-a05b-7b79bf148749 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
41622024-10-31T20:34:03.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2675 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 4203e5e2-66db-4d52-a05b-7b79bf148749 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
41632024-10-31T20:34:04.226ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 8a8d391b-078c-4620-8351-240969b19db1 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
41642024-10-31T20:34:04.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 8a8d391b-078c-4620-8351-240969b19db1 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
41652024-10-31T20:34:04.228ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2307 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 8a8d391b-078c-4620-8351-240969b19db1 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
41662024-10-31T20:34:05.250ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = fa80dca7-2156-4b40-8a3d-4b496bbffa6d roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
41672024-10-31T20:34:05.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = fa80dca7-2156-4b40-8a3d-4b496bbffa6d resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
41682024-10-31T20:34:05.252ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2585 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = fa80dca7-2156-4b40-8a3d-4b496bbffa6d response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
41692024-10-31T20:34:06.274ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 476d00f5-2380-46b4-bbab-32ea8a199bba roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
41702024-10-31T20:34:06.275ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 476d00f5-2380-46b4-bbab-32ea8a199bba resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
41712024-10-31T20:34:06.277ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2251 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 476d00f5-2380-46b4-bbab-32ea8a199bba response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
41722024-10-31T20:34:06.810ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:63156
41732024-10-31T20:34:06.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:63156 req_id = 4ae2aa15-c895-4402-add8-28278fbc791a roles = RoleSet { roles: {} } uri = /metrics/producers
41742024-10-31T20:34:06.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:63156 req_id = 4ae2aa15-c895-4402-add8-28278fbc791a resource = Database result = Ok(()) uri = /metrics/producers
41752024-10-31T20:34:06.823ZINFOnexus: assigned collector to new producer collector_id = 6e71f19b-440f-4a40-bbbb-fa1de5a7e58c file = nexus/src/app/oximeter.rs:76 producer_id = 622abb78-eb68-41c1-ac52-e7a263024e57
41762024-10-31T20:34:06.823ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 13078 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:63156 req_id = 4ae2aa15-c895-4402-add8-28278fbc791a response_code = 201 uri = /metrics/producers
41772024-10-31T20:34:07.299ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 97f7d483-8a96-4b63-a01b-5db1ec4e01d3 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
41782024-10-31T20:34:07.299ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 97f7d483-8a96-4b63-a01b-5db1ec4e01d3 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
41792024-10-31T20:34:07.301ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2427 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 97f7d483-8a96-4b63-a01b-5db1ec4e01d3 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
41802024-10-31T20:34:08.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 957b09ed-d418-4eb8-bf1f-2b2c570daa94 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
41812024-10-31T20:34:08.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 957b09ed-d418-4eb8-bf1f-2b2c570daa94 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
41822024-10-31T20:34:08.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2188 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 957b09ed-d418-4eb8-bf1f-2b2c570daa94 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
41832024-10-31T20:34:08.641ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
41842024-10-31T20:34:08.642ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41852024-10-31T20:34:08.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41862024-10-31T20:34:08.643ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
41872024-10-31T20:34:08.643ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41882024-10-31T20:34:08.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41892024-10-31T20:34:08.644ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41902024-10-31T20:34:08.646ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
41912024-10-31T20:34:08.646ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41922024-10-31T20:34:08.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41932024-10-31T20:34:08.649ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41942024-10-31T20:34:08.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41952024-10-31T20:34:08.651ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41962024-10-31T20:34:08.653ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 56b527e7-66b3-4602-a305-5dc763e7fb8b, lookup_type: ById(56b527e7-66b3-4602-a305-5dc763e7fb8b) } result = Ok(())
41972024-10-31T20:34:08.653ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41982024-10-31T20:34:08.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41992024-10-31T20:34:08.664ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b original_time_created = 2024-10-31 20:20:56.758465 UTC target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b time_created = 2024-10-31 20:20:56.758465 UTC
42002024-10-31T20:34:08.664ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.806061ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"56b527e7-66b3-4602-a305-5dc763e7fb8b","time_created":"2024-10-31T20:20:56.758465Z"}
42012024-10-31T20:34:08.671ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42022024-10-31T20:34:08.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42032024-10-31T20:34:08.698ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.753548ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42042024-10-31T20:34:09.348ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = b29b49d3-acb4-44e1-bcf7-6dd034291f3a roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
42052024-10-31T20:34:09.349ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = b29b49d3-acb4-44e1-bcf7-6dd034291f3a resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
42062024-10-31T20:34:09.351ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2520 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = b29b49d3-acb4-44e1-bcf7-6dd034291f3a response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
42072024-10-31T20:34:10.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 14e0cde6-fb51-49b5-9f5f-8501503ecd4f roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
42082024-10-31T20:34:10.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 14e0cde6-fb51-49b5-9f5f-8501503ecd4f resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
42092024-10-31T20:34:10.374ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2447 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 14e0cde6-fb51-49b5-9f5f-8501503ecd4f response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
42102024-10-31T20:34:11.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 729c9b2e-e98e-4039-ab75-b2693586c4ec roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
42112024-10-31T20:34:11.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 729c9b2e-e98e-4039-ab75-b2693586c4ec resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
42122024-10-31T20:34:11.397ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1910 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 729c9b2e-e98e-4039-ab75-b2693586c4ec response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
42132024-10-31T20:34:12.420ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = ae10ffaa-bb03-4874-a5e4-af1e5b1534ce roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
42142024-10-31T20:34:12.421ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = ae10ffaa-bb03-4874-a5e4-af1e5b1534ce resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
42152024-10-31T20:34:12.422ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2006 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = ae10ffaa-bb03-4874-a5e4-af1e5b1534ce response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
42162024-10-31T20:34:13.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 580a3221-eb42-4712-9fbc-9c59151afc4c roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
42172024-10-31T20:34:13.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 580a3221-eb42-4712-9fbc-9c59151afc4c resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
42182024-10-31T20:34:13.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2098 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 580a3221-eb42-4712-9fbc-9c59151afc4c response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
42192024-10-31T20:34:14.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46541 req_id = 9bc96bac-66ea-4f68-b9ca-57618846a313 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
42202024-10-31T20:34:14.299ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46541 req_id = 9bc96bac-66ea-4f68-b9ca-57618846a313 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
42212024-10-31T20:34:14.302ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3811 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46541 req_id = 9bc96bac-66ea-4f68-b9ca-57618846a313 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
42222024-10-31T20:34:14.469ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 9471b4b9-936d-4b18-9e95-29d73379a238 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
42232024-10-31T20:34:14.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 9471b4b9-936d-4b18-9e95-29d73379a238 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
42242024-10-31T20:34:14.471ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2372 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 9471b4b9-936d-4b18-9e95-29d73379a238 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
42252024-10-31T20:34:15.493ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = f68bc986-7afa-46f6-9133-2772726a409f roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
42262024-10-31T20:34:15.493ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = f68bc986-7afa-46f6-9133-2772726a409f resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
42272024-10-31T20:34:15.495ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2086 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = f68bc986-7afa-46f6-9133-2772726a409f response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
42282024-10-31T20:34:16.517ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 7aeb04fb-9f72-452c-8586-e8b963196dae roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
42292024-10-31T20:34:16.517ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 7aeb04fb-9f72-452c-8586-e8b963196dae resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
42302024-10-31T20:34:16.518ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1810 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 7aeb04fb-9f72-452c-8586-e8b963196dae response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
42312024-10-31T20:34:17.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 8d03ae84-1992-4ebd-9fe4-c6f1c2135dfe roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
42322024-10-31T20:34:17.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 8d03ae84-1992-4ebd-9fe4-c6f1c2135dfe resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
42332024-10-31T20:34:17.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2463 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 8d03ae84-1992-4ebd-9fe4-c6f1c2135dfe response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
42342024-10-31T20:34:17.826ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1322 local_addr = [fd00:1122:3344:101::c]:63183 method = GET remote_addr = [fd00:1122:3344:101::d]:38560 req_id = 16e34391-4c0a-4e32-a9e8-739220e66e72 response_code = 200 uri = /d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
42352024-10-31T20:34:18.564ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 489dbc76-7df9-4451-9e3d-cf2efbde10e0 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
42362024-10-31T20:34:18.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 489dbc76-7df9-4451-9e3d-cf2efbde10e0 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
42372024-10-31T20:34:18.567ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2746 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 489dbc76-7df9-4451-9e3d-cf2efbde10e0 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
42382024-10-31T20:34:18.642ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
42392024-10-31T20:34:18.642ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
42402024-10-31T20:34:18.642ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 31 reason = Timeout
42412024-10-31T20:34:18.642ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
42422024-10-31T20:34:18.642ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42432024-10-31T20:34:18.642ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
42442024-10-31T20:34:18.642ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
42452024-10-31T20:34:18.642ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
42462024-10-31T20:34:18.642ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
42472024-10-31T20:34:18.642ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
42482024-10-31T20:34:18.642ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
42492024-10-31T20:34:18.642ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
42502024-10-31T20:34:18.642ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42512024-10-31T20:34:18.642ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42522024-10-31T20:34:18.642ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
42532024-10-31T20:34:18.642ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 15 reason = Timeout
42542024-10-31T20:34:18.642ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42552024-10-31T20:34:18.642ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
42562024-10-31T20:34:18.642ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42572024-10-31T20:34:18.642ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
42582024-10-31T20:34:18.642ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b
42592024-10-31T20:34:18.642ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 15 reason = Timeout
42602024-10-31T20:34:18.642ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.04\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"56b527e7-66b3-4602-a305-5dc763e7fb8b"}
42612024-10-31T20:34:18.642ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
42622024-10-31T20:34:18.642ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42632024-10-31T20:34:18.642ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
42642024-10-31T20:34:18.642ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 15 reason = Timeout
42652024-10-31T20:34:18.642ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-10-31 20:24:18.642779588 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
42662024-10-31T20:34:18.642ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
42672024-10-31T20:34:18.642ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42682024-10-31T20:34:18.642ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
42692024-10-31T20:34:18.642ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
42702024-10-31T20:34:18.642ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
42712024-10-31T20:34:18.642ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
42722024-10-31T20:34:18.642ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 15 reason = Timeout
42732024-10-31T20:34:18.642ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
42742024-10-31T20:34:18.642ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 15 reason = Timeout
42752024-10-31T20:34:18.642ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42762024-10-31T20:34:18.642ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
42772024-10-31T20:34:18.642ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
42782024-10-31T20:34:18.643ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
42792024-10-31T20:34:18.643ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.611\u{b5}s iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
42802024-10-31T20:34:18.643ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
42812024-10-31T20:34:18.643ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
42822024-10-31T20:34:18.643ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
42832024-10-31T20:34:18.643ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 8.35\u{b5}s iteration = 27 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
42842024-10-31T20:34:18.643ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
42852024-10-31T20:34:18.643ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
42862024-10-31T20:34:18.643ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
42872024-10-31T20:34:18.643ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 11.92\u{b5}s iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
42882024-10-31T20:34:18.643ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
42892024-10-31T20:34:18.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
42902024-10-31T20:34:18.643ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
42912024-10-31T20:34:18.643ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 29 reason = Timeout
42922024-10-31T20:34:18.643ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
42932024-10-31T20:34:18.643ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
42942024-10-31T20:34:18.643ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
42952024-10-31T20:34:18.643ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
42962024-10-31T20:34:18.643ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42972024-10-31T20:34:18.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42982024-10-31T20:34:18.643ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
42992024-10-31T20:34:18.643ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
43002024-10-31T20:34:18.643ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43012024-10-31T20:34:18.643ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 4.79\u{b5}s iteration = 27 status = {"errors":[],"records_set_to_done":[]}
43022024-10-31T20:34:18.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
43032024-10-31T20:34:18.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
43042024-10-31T20:34:18.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43052024-10-31T20:34:18.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
43062024-10-31T20:34:18.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43072024-10-31T20:34:18.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43082024-10-31T20:34:18.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43092024-10-31T20:34:18.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43102024-10-31T20:34:18.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43112024-10-31T20:34:18.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
43122024-10-31T20:34:18.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
43132024-10-31T20:34:18.643ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8e750a05-d6dd-412d-aac1-b776b5e7757f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8e764cc9-00d9-46ed-80f0-316c9e4e0a2b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f87fba37-8eb7-413a-91fe-8caa94515963.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f87fba37-8eb7-413a-91fe-8caa94515963.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1771, tv_nsec: 299030958 } })
43142024-10-31T20:34:18.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
43152024-10-31T20:34:18.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
43162024-10-31T20:34:18.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
43172024-10-31T20:34:18.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43182024-10-31T20:34:18.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43192024-10-31T20:34:18.643ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("02376501-3235-4cfe-a1cd-82b53358d277.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a8364658-9f18-48ec-a891-264e5c9fbbb6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("a8364658-9f18-48ec-a891-264e5c9fbbb6.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1771, tv_nsec: 299108359 } })
43202024-10-31T20:34:18.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43212024-10-31T20:34:18.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43222024-10-31T20:34:18.643ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
43232024-10-31T20:34:18.643ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.114289ms iteration = 15 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
43242024-10-31T20:34:18.643ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
43252024-10-31T20:34:18.643ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.271093ms iteration = 15 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
43262024-10-31T20:34:18.645ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1771, tv_nsec: 301200056 } })
43272024-10-31T20:34:18.645ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
43282024-10-31T20:34:18.646ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43292024-10-31T20:34:18.646ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.615294ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
43302024-10-31T20:34:18.646ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43312024-10-31T20:34:18.648ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
43322024-10-31T20:34:18.648ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43332024-10-31T20:34:18.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43342024-10-31T20:34:18.649ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
43352024-10-31T20:34:18.649ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
43362024-10-31T20:34:18.649ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1771, tv_nsec: 305009383 } })
43372024-10-31T20:34:18.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
43382024-10-31T20:34:18.649ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
43392024-10-31T20:34:18.650ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43402024-10-31T20:34:18.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43412024-10-31T20:34:18.651ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43422024-10-31T20:34:18.651ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43432024-10-31T20:34:18.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43442024-10-31T20:34:18.653ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 10.82612ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
43452024-10-31T20:34:18.653ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
43462024-10-31T20:34:18.653ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43472024-10-31T20:34:18.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43482024-10-31T20:34:18.654ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-10-31 20:24:18.642779588 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
43492024-10-31T20:34:18.654ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 11.41561ms iteration = 14 status = {"expiration":"2024-10-31T20:24:18.642779588Z","pruned":[]}
43502024-10-31T20:34:18.660ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43512024-10-31T20:34:18.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43522024-10-31T20:34:18.666ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43532024-10-31T20:34:18.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43542024-10-31T20:34:18.684ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43552024-10-31T20:34:18.688ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
43562024-10-31T20:34:18.688ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43572024-10-31T20:34:18.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43582024-10-31T20:34:18.690ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43592024-10-31T20:34:18.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43602024-10-31T20:34:18.692ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43612024-10-31T20:34:18.693ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
43622024-10-31T20:34:18.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
43632024-10-31T20:34:18.694ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43642024-10-31T20:34:18.695ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 56b527e7-66b3-4602-a305-5dc763e7fb8b, lookup_type: ById(56b527e7-66b3-4602-a305-5dc763e7fb8b) } result = Ok(())
43652024-10-31T20:34:18.695ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43662024-10-31T20:34:18.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43672024-10-31T20:34:18.697ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
43682024-10-31T20:34:18.697ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
43692024-10-31T20:34:18.697ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 54.473816ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
43702024-10-31T20:34:18.698ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
43712024-10-31T20:34:18.698ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43722024-10-31T20:34:18.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43732024-10-31T20:34:18.698ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43742024-10-31T20:34:18.699ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43752024-10-31T20:34:18.701ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
43762024-10-31T20:34:18.701ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
43772024-10-31T20:34:18.701ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43782024-10-31T20:34:18.701ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 58.767211ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
43792024-10-31T20:34:18.701ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
43802024-10-31T20:34:18.701ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
43812024-10-31T20:34:18.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
43822024-10-31T20:34:18.702ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
43832024-10-31T20:34:18.702ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43842024-10-31T20:34:18.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43852024-10-31T20:34:18.704ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
43862024-10-31T20:34:18.704ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43872024-10-31T20:34:18.704ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43882024-10-31T20:34:18.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43892024-10-31T20:34:18.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43902024-10-31T20:34:18.705ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
43912024-10-31T20:34:18.705ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
43922024-10-31T20:34:18.705ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43932024-10-31T20:34:18.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43942024-10-31T20:34:18.706ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43952024-10-31T20:34:18.706ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43962024-10-31T20:34:18.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43972024-10-31T20:34:18.707ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1771, tv_nsec: 363365727 } })
43982024-10-31T20:34:18.707ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43992024-10-31T20:34:18.708ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439
44002024-10-31T20:34:18.708ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44012024-10-31T20:34:18.708ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
44022024-10-31T20:34:18.708ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44032024-10-31T20:34:18.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44042024-10-31T20:34:18.710ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44052024-10-31T20:34:18.713ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
44062024-10-31T20:34:18.714ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
44072024-10-31T20:34:18.717ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
44082024-10-31T20:34:18.717ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44092024-10-31T20:34:18.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44102024-10-31T20:34:18.718ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44112024-10-31T20:34:18.719ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b original_time_created = 2024-10-31 20:20:56.758465 UTC target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b time_created = 2024-10-31 20:20:56.758465 UTC
44122024-10-31T20:34:18.719ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 77.131743ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"56b527e7-66b3-4602-a305-5dc763e7fb8b","time_created":"2024-10-31T20:20:56.758465Z"}
44132024-10-31T20:34:18.719ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
44142024-10-31T20:34:18.719ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44152024-10-31T20:34:18.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44162024-10-31T20:34:18.731ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44172024-10-31T20:34:18.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44182024-10-31T20:34:18.733ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44192024-10-31T20:34:18.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44202024-10-31T20:34:18.734ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 92.270148ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
44212024-10-31T20:34:18.736ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44222024-10-31T20:34:18.736ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
44232024-10-31T20:34:18.736ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44242024-10-31T20:34:18.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44252024-10-31T20:34:18.743ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
44262024-10-31T20:34:18.743ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
44272024-10-31T20:34:18.743ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
44282024-10-31T20:34:18.743ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44292024-10-31T20:34:18.743ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
44302024-10-31T20:34:18.743ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
44312024-10-31T20:34:18.743ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
44322024-10-31T20:34:18.743ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44332024-10-31T20:34:18.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44342024-10-31T20:34:18.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44352024-10-31T20:34:18.745ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
44362024-10-31T20:34:18.745ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 102.405707ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
44372024-10-31T20:34:18.745ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44382024-10-31T20:34:18.746ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44392024-10-31T20:34:18.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44402024-10-31T20:34:18.748ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
44412024-10-31T20:34:18.748ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44422024-10-31T20:34:18.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44432024-10-31T20:34:18.748ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44442024-10-31T20:34:18.749ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
44452024-10-31T20:34:18.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
44462024-10-31T20:34:18.750ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
44472024-10-31T20:34:18.750ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44482024-10-31T20:34:18.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44492024-10-31T20:34:18.752ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
44502024-10-31T20:34:18.754ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
44512024-10-31T20:34:18.754ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
44522024-10-31T20:34:18.754ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44532024-10-31T20:34:18.755ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "943275e9-5d74-47b9-8424-30c00b9d899f", "content-length": "26", "date": "Thu, 31 Oct 2024 20:34:17 GMT"} })
44542024-10-31T20:34:18.755ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44552024-10-31T20:34:18.756ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
44562024-10-31T20:34:18.757ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 114.779044ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44572024-10-31T20:34:18.762ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44582024-10-31T20:34:18.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44592024-10-31T20:34:18.767ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44602024-10-31T20:34:18.767ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
44612024-10-31T20:34:18.767ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 124.379572ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
44622024-10-31T20:34:18.770ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
44632024-10-31T20:34:18.770ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44642024-10-31T20:34:18.770ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ad00731b-3865-42b2-b85a-a5c1b7d91bc0", "content-length": "26", "date": "Thu, 31 Oct 2024 20:34:17 GMT"} })
44652024-10-31T20:34:18.770ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44662024-10-31T20:34:18.771ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44672024-10-31T20:34:18.772ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44682024-10-31T20:34:18.772ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
44692024-10-31T20:34:18.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 622abb78-eb68-41c1-ac52-e7a263024e57, lookup_type: ById(622abb78-eb68-41c1-ac52-e7a263024e57) } result = Ok(())
44702024-10-31T20:34:18.774ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44712024-10-31T20:34:18.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44722024-10-31T20:34:18.777ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
44732024-10-31T20:34:18.777ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44742024-10-31T20:34:18.777ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 134.50758ms iteration = 27 status = 0
44752024-10-31T20:34:18.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44762024-10-31T20:34:18.778ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
44772024-10-31T20:34:18.778ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 1a5173f7-64b4-48db-9160-caa5913594e3 dns_zone_name = oxide.test found_so_far = 0 version = 2
44782024-10-31T20:34:18.778ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44792024-10-31T20:34:18.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44802024-10-31T20:34:18.781ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
44812024-10-31T20:34:18.781ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 9bbba0df-c792-4ba2-925b-ab02ed6483a1 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
44822024-10-31T20:34:18.781ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44832024-10-31T20:34:18.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44842024-10-31T20:34:18.809ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-10-31T20:21:09.823788Z, time_modified: 2024-10-31T20:21:09.823788Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9efc5118-5ea4-4fe1-a8c5-501dee3e98c0, db_silo: Silo { identity: SiloIdentity { id: 9efc5118-5ea4-4fe1-a8c5-501dee3e98c0, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-31T20:21:23.039241Z, time_modified: 2024-10-31T20:21:23.039241Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "fffc2e5c59e415981668ee3af9418c2de014d1976b7a03713830fdf9f35a71e6" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9efc5118-5ea4-4fe1-a8c5-501dee3e98c0, db_silo: Silo { identity: SiloIdentity { id: 9efc5118-5ea4-4fe1-a8c5-501dee3e98c0, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-31T20:21:23.039241Z, time_modified: 2024-10-31T20:21:23.039241Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "fffc2e5c59e415981668ee3af9418c2de014d1976b7a03713830fdf9f35a71e6" }] }) }
44852024-10-31T20:34:18.809ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 166.494381ms iteration = 15 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9efc5118-5ea4-4fe1-a8c5-501dee3e98c0","tls_certs":["fffc2e5c59e415981668ee3af9418c2de014d1976b7a03713830fdf9f35a71e6"]}},"default_endpoint":{"silo_id":"9efc5118-5ea4-4fe1-a8c5-501dee3e98c0","tls_certs":["fffc2e5c59e415981668ee3af9418c2de014d1976b7a03713830fdf9f35a71e6"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
44862024-10-31T20:34:18.823ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
44872024-10-31T20:34:18.823ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 180.943985ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
44882024-10-31T20:34:18.836ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 193.445264ms iteration = 31 status = {"physical_disks_added":0}
44892024-10-31T20:34:18.840ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 zone_address = fd00:1122:3344:101::2
44902024-10-31T20:34:18.840ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44912024-10-31T20:34:18.840ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "359e3d1b-cdc7-43f3-8020-4b5918994d1d", "content-length": "26", "date": "Thu, 31 Oct 2024 20:34:18 GMT"} })
44922024-10-31T20:34:18.840ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44932024-10-31T20:34:18.842ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439
44942024-10-31T20:34:18.879ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
44952024-10-31T20:34:18.879ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "56ae9db9-33fa-4d00-80f6-c2562121993e", "date": "Thu, 31 Oct 2024 20:34:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
44962024-10-31T20:34:18.879ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
44972024-10-31T20:34:18.881ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "3fa00973-f551-4c14-b16a-a1702b959319", "date": "Thu, 31 Oct 2024 20:34:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
44982024-10-31T20:34:18.881ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
44992024-10-31T20:34:18.884ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
45002024-10-31T20:34:18.884ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 242.030067ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
45012024-10-31T20:34:18.894ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45022024-10-31T20:34:18.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45032024-10-31T20:34:18.909ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
45042024-10-31T20:34:18.910ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
45052024-10-31T20:34:18.910ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d1f2e9e1-2a99-4c2c-97d2-db0acea8eb17", "content-length": "2", "date": "Thu, 31 Oct 2024 20:34:18 GMT"} })
45062024-10-31T20:34:18.913ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
45072024-10-31T20:34:18.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
45082024-10-31T20:34:18.939ZINFOnexus (BackgroundTasks): VPC route manager sled 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
45092024-10-31T20:34:18.939ZDEBGnexus (BackgroundTasks): client request SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
45102024-10-31T20:34:18.940ZDEBGnexus (BackgroundTasks): client response SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "71616ef5-bcb5-4a56-a986-7662e5bf0f21", "content-length": "372", "date": "Thu, 31 Oct 2024 20:34:18 GMT"} })
45112024-10-31T20:34:18.940ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45122024-10-31T20:34:18.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45132024-10-31T20:34:18.942ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45142024-10-31T20:34:18.942ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45152024-10-31T20:34:18.944ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45162024-10-31T20:34:18.947ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 304.194647ms iteration = 27 status = null
45172024-10-31T20:34:18.947ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
45182024-10-31T20:34:18.947ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45192024-10-31T20:34:18.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
45202024-10-31T20:34:18.950ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
45212024-10-31T20:34:18.950ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45222024-10-31T20:34:18.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
45232024-10-31T20:34:18.951ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
45242024-10-31T20:34:18.951ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45252024-10-31T20:34:18.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45262024-10-31T20:34:18.954ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 1a5173f7-64b4-48db-9160-caa5913594e3 dns_zone_name = oxide.test found_so_far = 1 version = 2
45272024-10-31T20:34:18.954ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
45282024-10-31T20:34:18.955ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-10-31 20:21:23.098854 UTC dns_group = external generation = 2
45292024-10-31T20:34:18.955ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 312.197778ms iteration = 15 status = {"generation":2}
45302024-10-31T20:34:18.955ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 9bbba0df-c792-4ba2-925b-ab02ed6483a1 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
45312024-10-31T20:34:18.955ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
45322024-10-31T20:34:18.955ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-10-31 20:21:21.652645 UTC dns_group = internal generation = 1
45332024-10-31T20:34:18.955ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 313.035353ms iteration = 15 status = {"generation":1}
45342024-10-31T20:34:18.986ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45352024-10-31T20:34:18.988ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 345.573123ms iteration = 27 status = {}
45362024-10-31T20:34:18.989ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
45372024-10-31T20:34:18.989ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45382024-10-31T20:34:18.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45392024-10-31T20:34:19.007ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
45402024-10-31T20:34:19.007ZDEBGnexus (BackgroundTasks): client request SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
45412024-10-31T20:34:19.007ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
45422024-10-31T20:34:19.008ZDEBGnexus (BackgroundTasks): client response SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7a54e48c-ada1-4db9-b282-37eb774d845c", "date": "Thu, 31 Oct 2024 20:34:18 GMT"} })
45432024-10-31T20:34:19.008ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45442024-10-31T20:34:19.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45452024-10-31T20:34:19.008ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "5db485ae-dcce-4197-83ab-565c768938c5", "date": "Thu, 31 Oct 2024 20:34:19 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
45462024-10-31T20:34:19.008ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
45472024-10-31T20:34:19.010ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "bf47b40c-5989-45f0-8e01-959fb9082671", "date": "Thu, 31 Oct 2024 20:34:19 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
45482024-10-31T20:34:19.010ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
45492024-10-31T20:34:19.012ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "ad429b70-aab3-4301-9847-1d91fac3a3e6", "date": "Thu, 31 Oct 2024 20:34:19 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
45502024-10-31T20:34:19.012ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
45512024-10-31T20:34:19.014ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
45522024-10-31T20:34:19.014ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 371.754973ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
45532024-10-31T20:34:19.060ZDEBGnexus (BackgroundTasks): client request SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
45542024-10-31T20:34:19.061ZDEBGnexus (BackgroundTasks): client response SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d4baf0ef-39d5-4064-a948-98255dae3fd3", "content-length": "691", "date": "Thu, 31 Oct 2024 20:34:18 GMT"} })
45552024-10-31T20:34:19.061ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
45562024-10-31T20:34:19.061ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
45572024-10-31T20:34:19.061ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
45582024-10-31T20:34:19.063ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 420.520739ms iteration = 28 status = {}
45592024-10-31T20:34:19.068ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45602024-10-31T20:34:19.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45612024-10-31T20:34:19.072ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45622024-10-31T20:34:19.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45632024-10-31T20:34:19.082ZINFOnexus (BackgroundTasks): VPC route manager sled 622abb78-eb68-41c1-ac52-e7a263024e57 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
45642024-10-31T20:34:19.083ZDEBGnexus (BackgroundTasks): client request SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
45652024-10-31T20:34:19.083ZDEBGnexus (BackgroundTasks): client response SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a34b6f26-fd87-4eba-948c-870e20b8d9bc", "date": "Thu, 31 Oct 2024 20:34:18 GMT"} })
45662024-10-31T20:34:19.085ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 442.835961ms iteration = 29 status = {}
45672024-10-31T20:34:19.125ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45682024-10-31T20:34:19.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45692024-10-31T20:34:19.127ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2c0ce4ae-e332-4e80-bd64-c2d6cfd99f8f, rack_id: cf9a2d24-88ed-47a2-a402-0cbbba2d1439, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(1479dccf-28ea-4cc0-9964-818390bddf17) } rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 switch_location = Switch0
45702024-10-31T20:34:19.127ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45712024-10-31T20:34:19.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45722024-10-31T20:34:19.138ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
45732024-10-31T20:34:19.138ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "83257a53-d736-4efe-857e-2c25d2ca0306", "content-length": "121", "date": "Thu, 31 Oct 2024 20:34:19 GMT"} })
45742024-10-31T20:34:19.138ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
45752024-10-31T20:34:19.138ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 1479dccf-28ea-4cc0-9964-818390bddf17
45762024-10-31T20:34:19.138ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
45772024-10-31T20:34:19.139ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
45782024-10-31T20:34:19.139ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
45792024-10-31T20:34:19.139ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
45802024-10-31T20:34:19.139ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
45812024-10-31T20:34:19.139ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
45822024-10-31T20:34:19.139ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
45832024-10-31T20:34:19.139ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
45842024-10-31T20:34:19.139ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439
45852024-10-31T20:34:19.139ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45862024-10-31T20:34:19.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45872024-10-31T20:34:19.142ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
45882024-10-31T20:34:19.142ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "d285e757-416d-41e9-bbec-24898a78736d", "content-length": "2", "date": "Thu, 31 Oct 2024 20:34:19 GMT"} })
45892024-10-31T20:34:19.142ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
45902024-10-31T20:34:19.142ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f23e310-814c-40cb-a824-e6b5e3ab7f06", "content-length": "52", "date": "Thu, 31 Oct 2024 20:34:19 GMT"} })
45912024-10-31T20:34:19.142ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 switch_location = Switch0
45922024-10-31T20:34:19.142ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
45932024-10-31T20:34:19.262ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4d76f1b6-a910-4ea7-b885-40bc526feba9", "date": "Thu, 31 Oct 2024 20:34:18 GMT"} })
45942024-10-31T20:34:19.262ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 switch = Switch0
45952024-10-31T20:34:19.262ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
45962024-10-31T20:34:19.262ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c5ba5d8-7f53-40d6-9426-f74ef30b49b8", "content-length": "669", "date": "Thu, 31 Oct 2024 20:34:18 GMT"} })
45972024-10-31T20:34:19.262ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45982024-10-31T20:34:19.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45992024-10-31T20:34:19.266ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46002024-10-31T20:34:19.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46012024-10-31T20:34:19.271ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46022024-10-31T20:34:19.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46032024-10-31T20:34:19.274ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46042024-10-31T20:34:19.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46052024-10-31T20:34:19.281ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 638.495244ms iteration = 27 status = {}
46062024-10-31T20:34:19.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 26803229-c559-4359-8250-8183c7dbaf46 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
46072024-10-31T20:34:19.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 26803229-c559-4359-8250-8183c7dbaf46 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
46082024-10-31T20:34:19.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2537 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 26803229-c559-4359-8250-8183c7dbaf46 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
46092024-10-31T20:34:20.630ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = de64ea0e-a3c2-486b-8475-b1b9adefec59 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
46102024-10-31T20:34:20.630ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = de64ea0e-a3c2-486b-8475-b1b9adefec59 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
46112024-10-31T20:34:20.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2095 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = de64ea0e-a3c2-486b-8475-b1b9adefec59 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
46122024-10-31T20:34:21.653ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = f0704e62-5f86-4847-ae00-9af95c4b7b9b roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
46132024-10-31T20:34:21.653ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = f0704e62-5f86-4847-ae00-9af95c4b7b9b resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
46142024-10-31T20:34:21.655ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2336 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = f0704e62-5f86-4847-ae00-9af95c4b7b9b response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
46152024-10-31T20:34:22.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 32d8fee6-fee0-4c5f-ad8e-b34b01f49308 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
46162024-10-31T20:34:22.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 32d8fee6-fee0-4c5f-ad8e-b34b01f49308 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
46172024-10-31T20:34:22.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2264 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 32d8fee6-fee0-4c5f-ad8e-b34b01f49308 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
46182024-10-31T20:34:22.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = f779608f-6e4c-415f-bf5f-014eaad4aee9 roles = RoleSet { roles: {} } uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?sort_by=id_ascending
46192024-10-31T20:34:22.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = f779608f-6e4c-415f-bf5f-014eaad4aee9 resource = Database result = Ok(()) uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?sort_by=id_ascending
46202024-10-31T20:34:22.820ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3449 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = f779608f-6e4c-415f-bf5f-014eaad4aee9 response_code = 200 uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?sort_by=id_ascending
46212024-10-31T20:34:22.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = b19c90a4-a795-4de0-b452-c3f94074d5d7 roles = RoleSet { roles: {} } uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzA4NDI3Ny1iNmFhLTQ1OWYtOGY4MS1mNGVmNGM3Yzg0M2UifX0%3D
46222024-10-31T20:34:22.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = b19c90a4-a795-4de0-b452-c3f94074d5d7 resource = Database result = Ok(()) uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzA4NDI3Ny1iNmFhLTQ1OWYtOGY4MS1mNGVmNGM3Yzg0M2UifX0%3D
46232024-10-31T20:34:22.823ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2633 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = b19c90a4-a795-4de0-b452-c3f94074d5d7 response_code = 200 uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzA4NDI3Ny1iNmFhLTQ1OWYtOGY4MS1mNGVmNGM3Yzg0M2UifX0%3D
46242024-10-31T20:34:23.701ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 2457e152-b949-4a7b-92e6-dade2f15d8a4 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
46252024-10-31T20:34:23.701ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 2457e152-b949-4a7b-92e6-dade2f15d8a4 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
46262024-10-31T20:34:23.703ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2222 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 2457e152-b949-4a7b-92e6-dade2f15d8a4 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
46272024-10-31T20:34:23.819ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:47841
46282024-10-31T20:34:23.819ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:47841 req_id = 8f8bcdc8-c61b-4325-93ba-437434471854 roles = RoleSet { roles: {} } uri = /metrics/producers
46292024-10-31T20:34:23.820ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:47841 req_id = 8f8bcdc8-c61b-4325-93ba-437434471854 resource = Database result = Ok(()) uri = /metrics/producers
46302024-10-31T20:34:23.855ZINFOnexus: assigned collector to new producer collector_id = 6e71f19b-440f-4a40-bbbb-fa1de5a7e58c file = nexus/src/app/oximeter.rs:76 producer_id = dbdc11ca-09be-4e87-97a8-f84248e8e42f
46312024-10-31T20:34:23.855ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 35446 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:47841 req_id = 8f8bcdc8-c61b-4325-93ba-437434471854 response_code = 201 uri = /metrics/producers
46322024-10-31T20:34:24.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = f9ce7fbf-5a7d-4c8d-9b6e-5f8e23a7972f roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
46332024-10-31T20:34:24.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = f9ce7fbf-5a7d-4c8d-9b6e-5f8e23a7972f resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
46342024-10-31T20:34:24.726ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1827 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = f9ce7fbf-5a7d-4c8d-9b6e-5f8e23a7972f response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
46352024-10-31T20:34:25.611ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:58549
46362024-10-31T20:34:25.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58549 req_id = 208ea39b-1ac1-4876-921a-25584c29ce1c roles = RoleSet { roles: {} } uri = /metrics/producers
46372024-10-31T20:34:25.611ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58549 req_id = 208ea39b-1ac1-4876-921a-25584c29ce1c resource = Database result = Ok(()) uri = /metrics/producers
46382024-10-31T20:34:25.646ZINFOnexus: assigned collector to new producer collector_id = 6e71f19b-440f-4a40-bbbb-fa1de5a7e58c file = nexus/src/app/oximeter.rs:76 producer_id = 27b3ab0c-2f83-43d0-9859-6d0be2e2cbca
46392024-10-31T20:34:25.646ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 35383 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58549 req_id = 208ea39b-1ac1-4876-921a-25584c29ce1c response_code = 201 uri = /metrics/producers
46402024-10-31T20:34:25.750ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = d6315da7-87fd-4274-8414-3faad9b15b2e roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
46412024-10-31T20:34:25.750ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = d6315da7-87fd-4274-8414-3faad9b15b2e resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
46422024-10-31T20:34:25.752ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2292 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = d6315da7-87fd-4274-8414-3faad9b15b2e response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
46432024-10-31T20:34:26.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 841ec16d-a9a5-414c-8935-76ad225ac61e roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
46442024-10-31T20:34:26.774ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 841ec16d-a9a5-414c-8935-76ad225ac61e resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
46452024-10-31T20:34:26.776ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2909 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 841ec16d-a9a5-414c-8935-76ad225ac61e response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
46462024-10-31T20:34:27.798ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = e40531c0-7593-4e13-ac96-f138140a4640 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
46472024-10-31T20:34:27.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = e40531c0-7593-4e13-ac96-f138140a4640 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
46482024-10-31T20:34:27.800ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2402 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = e40531c0-7593-4e13-ac96-f138140a4640 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
46492024-10-31T20:34:28.642ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
46502024-10-31T20:34:28.642ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46512024-10-31T20:34:28.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46522024-10-31T20:34:28.643ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
46532024-10-31T20:34:28.643ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46542024-10-31T20:34:28.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46552024-10-31T20:34:28.645ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46562024-10-31T20:34:28.647ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
46572024-10-31T20:34:28.647ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46582024-10-31T20:34:28.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46592024-10-31T20:34:28.650ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46602024-10-31T20:34:28.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46612024-10-31T20:34:28.677ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46622024-10-31T20:34:28.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46632024-10-31T20:34:28.680ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46642024-10-31T20:34:28.683ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 56b527e7-66b3-4602-a305-5dc763e7fb8b, lookup_type: ById(56b527e7-66b3-4602-a305-5dc763e7fb8b) } result = Ok(())
46652024-10-31T20:34:28.683ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46662024-10-31T20:34:28.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46672024-10-31T20:34:28.696ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b original_time_created = 2024-10-31 20:20:56.758465 UTC target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b time_created = 2024-10-31 20:20:56.758465 UTC
46682024-10-31T20:34:28.696ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 54.12641ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"56b527e7-66b3-4602-a305-5dc763e7fb8b","time_created":"2024-10-31T20:20:56.758465Z"}
46692024-10-31T20:34:28.705ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.748024ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
46702024-10-31T20:34:28.822ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 54126a1c-d173-46c9-807f-793a927a0075 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
46712024-10-31T20:34:28.822ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 54126a1c-d173-46c9-807f-793a927a0075 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
46722024-10-31T20:34:28.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2401 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 54126a1c-d173-46c9-807f-793a927a0075 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
46732024-10-31T20:34:29.847ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = fcb9a054-9ff3-4b95-92bc-272bf9d42027 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
46742024-10-31T20:34:29.847ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = fcb9a054-9ff3-4b95-92bc-272bf9d42027 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
46752024-10-31T20:34:29.849ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2195 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = fcb9a054-9ff3-4b95-92bc-272bf9d42027 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
46762024-10-31T20:34:30.869ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = dcf3c56d-1716-4c6f-a9d8-1e754ccb23ba roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
46772024-10-31T20:34:30.869ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = dcf3c56d-1716-4c6f-a9d8-1e754ccb23ba resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
46782024-10-31T20:34:30.871ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2235 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = dcf3c56d-1716-4c6f-a9d8-1e754ccb23ba response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
46792024-10-31T20:34:31.893ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 1fd2de01-5e69-4c8f-a44c-3217a183bbbe roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
46802024-10-31T20:34:31.893ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 1fd2de01-5e69-4c8f-a44c-3217a183bbbe resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
46812024-10-31T20:34:31.895ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2345 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 1fd2de01-5e69-4c8f-a44c-3217a183bbbe response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
46822024-10-31T20:34:32.826ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1252 local_addr = [fd00:1122:3344:101::c]:63183 method = GET remote_addr = [fd00:1122:3344:101::d]:38560 req_id = 9d1241a8-a073-4dc9-a070-b4bc732f9946 response_code = 200 uri = /d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
46832024-10-31T20:34:32.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = cfe6736b-168a-4f42-9c77-8ed24da430a8 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
46842024-10-31T20:34:32.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = cfe6736b-168a-4f42-9c77-8ed24da430a8 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
46852024-10-31T20:34:32.919ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2024 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = cfe6736b-168a-4f42-9c77-8ed24da430a8 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
46862024-10-31T20:34:33.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = d0946a48-2ee3-40f9-bb30-8173ce4efd1d roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
46872024-10-31T20:34:33.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = d0946a48-2ee3-40f9-bb30-8173ce4efd1d resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
46882024-10-31T20:34:33.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2347 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = d0946a48-2ee3-40f9-bb30-8173ce4efd1d response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
46892024-10-31T20:34:34.966ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = cdc0428a-f1dd-4e8b-9f29-c79030fb486e roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
46902024-10-31T20:34:34.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = cdc0428a-f1dd-4e8b-9f29-c79030fb486e resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
46912024-10-31T20:34:34.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2227 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = cdc0428a-f1dd-4e8b-9f29-c79030fb486e response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
46922024-10-31T20:34:35.991ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 52535fc4-2ca7-4fba-a037-2cac1555b13a roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
46932024-10-31T20:34:35.992ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 52535fc4-2ca7-4fba-a037-2cac1555b13a resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
46942024-10-31T20:34:35.994ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2225 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 52535fc4-2ca7-4fba-a037-2cac1555b13a response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
46952024-10-31T20:34:37.016ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = be803df7-bc70-4f80-aa95-0cd006cce015 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
46962024-10-31T20:34:37.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = be803df7-bc70-4f80-aa95-0cd006cce015 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
46972024-10-31T20:34:37.018ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2191 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = be803df7-bc70-4f80-aa95-0cd006cce015 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
46982024-10-31T20:34:38.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 14b6686f-5df6-4da3-9fdb-eb5e712dcfb7 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
46992024-10-31T20:34:38.041ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 14b6686f-5df6-4da3-9fdb-eb5e712dcfb7 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
47002024-10-31T20:34:38.043ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2459 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 14b6686f-5df6-4da3-9fdb-eb5e712dcfb7 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
47012024-10-31T20:34:38.642ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
47022024-10-31T20:34:38.642ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47032024-10-31T20:34:38.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47042024-10-31T20:34:38.643ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
47052024-10-31T20:34:38.643ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47062024-10-31T20:34:38.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47072024-10-31T20:34:38.644ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47082024-10-31T20:34:38.645ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47092024-10-31T20:34:38.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47102024-10-31T20:34:38.647ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47112024-10-31T20:34:38.647ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47122024-10-31T20:34:38.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47132024-10-31T20:34:38.647ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.110122ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47142024-10-31T20:34:38.648ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47152024-10-31T20:34:38.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47162024-10-31T20:34:38.650ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47172024-10-31T20:34:38.652ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 56b527e7-66b3-4602-a305-5dc763e7fb8b, lookup_type: ById(56b527e7-66b3-4602-a305-5dc763e7fb8b) } result = Ok(())
47182024-10-31T20:34:38.652ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47192024-10-31T20:34:38.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47202024-10-31T20:34:38.663ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b original_time_created = 2024-10-31 20:20:56.758465 UTC target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b time_created = 2024-10-31 20:20:56.758465 UTC
47212024-10-31T20:34:38.663ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.798692ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"56b527e7-66b3-4602-a305-5dc763e7fb8b","time_created":"2024-10-31T20:20:56.758465Z"}
47222024-10-31T20:34:39.066ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = d7fc0787-de6a-4748-aad1-0fae2ed14a9b roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
47232024-10-31T20:34:39.066ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = d7fc0787-de6a-4748-aad1-0fae2ed14a9b resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
47242024-10-31T20:34:39.068ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1918 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = d7fc0787-de6a-4748-aad1-0fae2ed14a9b response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
47252024-10-31T20:34:40.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = f22aa1d0-f0eb-4f4d-9b6c-12a5c5d43057 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
47262024-10-31T20:34:40.089ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = f22aa1d0-f0eb-4f4d-9b6c-12a5c5d43057 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
47272024-10-31T20:34:40.091ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2481 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = f22aa1d0-f0eb-4f4d-9b6c-12a5c5d43057 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
47282024-10-31T20:34:41.111ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 15c3cf22-8a84-44a1-b43e-6220c584d244 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
47292024-10-31T20:34:41.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 15c3cf22-8a84-44a1-b43e-6220c584d244 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
47302024-10-31T20:34:41.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2567 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 15c3cf22-8a84-44a1-b43e-6220c584d244 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
47312024-10-31T20:34:42.135ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 00b0bbae-58c6-4f12-a34d-bdd20e625118 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
47322024-10-31T20:34:42.135ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 00b0bbae-58c6-4f12-a34d-bdd20e625118 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
47332024-10-31T20:34:42.137ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1824 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 00b0bbae-58c6-4f12-a34d-bdd20e625118 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
47342024-10-31T20:34:43.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 4ad970d3-3050-472b-82ae-2923a51e35ce roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
47352024-10-31T20:34:43.160ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 4ad970d3-3050-472b-82ae-2923a51e35ce resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
47362024-10-31T20:34:43.162ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2688 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 4ad970d3-3050-472b-82ae-2923a51e35ce response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
47372024-10-31T20:34:43.246ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:43366
47382024-10-31T20:34:43.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43366 req_id = 73af9175-3d2a-4444-a3ba-75f0b90f4b55 roles = RoleSet { roles: {} } uri = /metrics/producers
47392024-10-31T20:34:43.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43366 req_id = 73af9175-3d2a-4444-a3ba-75f0b90f4b55 resource = Database result = Ok(()) uri = /metrics/producers
47402024-10-31T20:34:43.288ZINFOnexus: assigned collector to new producer collector_id = 6e71f19b-440f-4a40-bbbb-fa1de5a7e58c file = nexus/src/app/oximeter.rs:76 producer_id = f7084277-b6aa-459f-8f81-f4ef4c7c843e
47412024-10-31T20:34:43.288ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 41737 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43366 req_id = 73af9175-3d2a-4444-a3ba-75f0b90f4b55 response_code = 201 uri = /metrics/producers
47422024-10-31T20:34:44.184ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 0012c1dc-562b-418e-9dc4-d55e9935d2b2 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
47432024-10-31T20:34:44.185ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 0012c1dc-562b-418e-9dc4-d55e9935d2b2 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
47442024-10-31T20:34:44.187ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2426 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 0012c1dc-562b-418e-9dc4-d55e9935d2b2 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
47452024-10-31T20:34:44.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46541 req_id = 8859e2c0-4566-4980-a951-2e72845d8daa roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
47462024-10-31T20:34:44.336ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46541 req_id = 8859e2c0-4566-4980-a951-2e72845d8daa resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
47472024-10-31T20:34:44.338ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2927 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46541 req_id = 8859e2c0-4566-4980-a951-2e72845d8daa response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
47482024-10-31T20:34:45.208ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 6be2f34d-6db5-4a05-9cf0-f94886c363b9 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
47492024-10-31T20:34:45.209ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 6be2f34d-6db5-4a05-9cf0-f94886c363b9 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
47502024-10-31T20:34:45.211ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2747 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 6be2f34d-6db5-4a05-9cf0-f94886c363b9 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
47512024-10-31T20:34:46.233ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 5257875a-fb8e-4a0e-a005-664333a61798 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
47522024-10-31T20:34:46.233ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 5257875a-fb8e-4a0e-a005-664333a61798 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
47532024-10-31T20:34:46.235ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2695 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 5257875a-fb8e-4a0e-a005-664333a61798 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
47542024-10-31T20:34:47.259ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 5e835620-f185-4f22-b978-a358c4147985 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
47552024-10-31T20:34:47.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 5e835620-f185-4f22-b978-a358c4147985 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
47562024-10-31T20:34:47.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2585 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 5e835620-f185-4f22-b978-a358c4147985 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
47572024-10-31T20:34:47.825ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1786 local_addr = [fd00:1122:3344:101::c]:63183 method = GET remote_addr = [fd00:1122:3344:101::d]:38560 req_id = 80496511-83fb-4683-8185-4cc5a9a882af response_code = 200 uri = /d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
47582024-10-31T20:34:48.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 3e2e2222-bad8-4c3f-9dba-3644dbe64f3a roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
47592024-10-31T20:34:48.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 3e2e2222-bad8-4c3f-9dba-3644dbe64f3a resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
47602024-10-31T20:34:48.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2359 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 3e2e2222-bad8-4c3f-9dba-3644dbe64f3a response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
47612024-10-31T20:34:48.642ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 28 reason = Timeout
47622024-10-31T20:34:48.642ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 82 reason = Timeout
47632024-10-31T20:34:48.642ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47642024-10-31T20:34:48.642ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47652024-10-31T20:34:48.642ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 28 reason = Timeout
47662024-10-31T20:34:48.642ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 32 reason = Timeout
47672024-10-31T20:34:48.642ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47682024-10-31T20:34:48.642ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 29 reason = Timeout
47692024-10-31T20:34:48.642ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47702024-10-31T20:34:48.642ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47712024-10-31T20:34:48.642ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 28 reason = Timeout
47722024-10-31T20:34:48.642ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
47732024-10-31T20:34:48.642ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 28 reason = Timeout
47742024-10-31T20:34:48.642ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
47752024-10-31T20:34:48.642ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 28 reason = Timeout
47762024-10-31T20:34:48.642ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 28 reason = Timeout
47772024-10-31T20:34:48.642ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
47782024-10-31T20:34:48.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47792024-10-31T20:34:48.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47802024-10-31T20:34:48.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47812024-10-31T20:34:48.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
47822024-10-31T20:34:48.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47832024-10-31T20:34:48.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47842024-10-31T20:34:48.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
47852024-10-31T20:34:48.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
47862024-10-31T20:34:48.643ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 30 reason = Timeout
47872024-10-31T20:34:48.643ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
47882024-10-31T20:34:48.643ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 28 reason = Timeout
47892024-10-31T20:34:48.643ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
47902024-10-31T20:34:48.643ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47912024-10-31T20:34:48.643ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 82 reason = Timeout
47922024-10-31T20:34:48.643ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47932024-10-31T20:34:48.643ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 28 reason = Timeout
47942024-10-31T20:34:48.643ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 7.571\u{b5}s iteration = 28 status = {"errors":[],"records_set_to_done":[]}
47952024-10-31T20:34:48.643ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 28 reason = Timeout
47962024-10-31T20:34:48.643ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 28 reason = Timeout
47972024-10-31T20:34:48.643ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 3.7\u{b5}s iteration = 28 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
47982024-10-31T20:34:48.643ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
47992024-10-31T20:34:48.643ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 7.56\u{b5}s iteration = 28 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
48002024-10-31T20:34:48.643ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
48012024-10-31T20:34:48.643ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 28 reason = Timeout
48022024-10-31T20:34:48.643ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
48032024-10-31T20:34:48.643ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.34\u{b5}s iteration = 28 status = {"errors":[],"garbage_collect_requested":[]}
48042024-10-31T20:34:48.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
48052024-10-31T20:34:48.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48062024-10-31T20:34:48.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
48072024-10-31T20:34:48.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48082024-10-31T20:34:48.645ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48092024-10-31T20:34:48.645ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48102024-10-31T20:34:48.646ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48112024-10-31T20:34:48.647ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.687572ms iteration = 28 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
48122024-10-31T20:34:48.647ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1801, tv_nsec: 302567100 } })
48132024-10-31T20:34:48.647ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
48142024-10-31T20:34:48.647ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48152024-10-31T20:34:48.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48162024-10-31T20:34:48.647ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
48172024-10-31T20:34:48.648ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
48182024-10-31T20:34:48.648ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48192024-10-31T20:34:48.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48202024-10-31T20:34:48.649ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
48212024-10-31T20:34:48.649ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48222024-10-31T20:34:48.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48232024-10-31T20:34:48.651ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48242024-10-31T20:34:48.651ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1801, tv_nsec: 306907016 } })
48252024-10-31T20:34:48.651ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
48262024-10-31T20:34:48.652ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48272024-10-31T20:34:48.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48282024-10-31T20:34:48.652ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48292024-10-31T20:34:48.653ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1801, tv_nsec: 309209976 } })
48302024-10-31T20:34:48.654ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439
48312024-10-31T20:34:48.654ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
48322024-10-31T20:34:48.654ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
48332024-10-31T20:34:48.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
48342024-10-31T20:34:48.654ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
48352024-10-31T20:34:48.654ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48362024-10-31T20:34:48.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48372024-10-31T20:34:48.656ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48382024-10-31T20:34:48.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48392024-10-31T20:34:48.656ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48402024-10-31T20:34:48.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48412024-10-31T20:34:48.657ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48422024-10-31T20:34:48.659ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
48432024-10-31T20:34:48.659ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48442024-10-31T20:34:48.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48452024-10-31T20:34:48.682ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48462024-10-31T20:34:48.683ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48472024-10-31T20:34:48.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48482024-10-31T20:34:48.684ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
48492024-10-31T20:34:48.684ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48502024-10-31T20:34:48.684ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
48512024-10-31T20:34:48.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48522024-10-31T20:34:48.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
48532024-10-31T20:34:48.686ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48542024-10-31T20:34:48.686ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48552024-10-31T20:34:48.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48562024-10-31T20:34:48.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48572024-10-31T20:34:48.687ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 44.878257ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
48582024-10-31T20:34:48.687ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
48592024-10-31T20:34:48.687ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
48602024-10-31T20:34:48.687ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
48612024-10-31T20:34:48.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
48622024-10-31T20:34:48.688ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48632024-10-31T20:34:48.689ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48642024-10-31T20:34:48.690ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 47.151428ms iteration = 82 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
48652024-10-31T20:34:48.691ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
48662024-10-31T20:34:48.691ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48672024-10-31T20:34:48.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48682024-10-31T20:34:48.692ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 622abb78-eb68-41c1-ac52-e7a263024e57, lookup_type: ById(622abb78-eb68-41c1-ac52-e7a263024e57) } result = Ok(())
48692024-10-31T20:34:48.692ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48702024-10-31T20:34:48.692ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48712024-10-31T20:34:48.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48722024-10-31T20:34:48.693ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
48732024-10-31T20:34:48.693ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 50.220671ms iteration = 28 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
48742024-10-31T20:34:48.694ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 51.965272ms iteration = 28 status = 0
48752024-10-31T20:34:48.694ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 56b527e7-66b3-4602-a305-5dc763e7fb8b, lookup_type: ById(56b527e7-66b3-4602-a305-5dc763e7fb8b) } result = Ok(())
48762024-10-31T20:34:48.694ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48772024-10-31T20:34:48.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48782024-10-31T20:34:48.706ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b original_time_created = 2024-10-31 20:20:56.758465 UTC target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b time_created = 2024-10-31 20:20:56.758465 UTC
48792024-10-31T20:34:48.706ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 63.936572ms iteration = 82 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"56b527e7-66b3-4602-a305-5dc763e7fb8b","time_created":"2024-10-31T20:20:56.758465Z"}
48802024-10-31T20:34:48.723ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
48812024-10-31T20:34:48.724ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
48822024-10-31T20:34:48.724ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb217efd-8584-4f01-a5a1-c1c183b63190", "content-length": "26", "date": "Thu, 31 Oct 2024 20:34:47 GMT"} })
48832024-10-31T20:34:48.724ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
48842024-10-31T20:34:48.725ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
48852024-10-31T20:34:48.725ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
48862024-10-31T20:34:48.725ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
48872024-10-31T20:34:48.725ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
48882024-10-31T20:34:48.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
48892024-10-31T20:34:48.728ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
48902024-10-31T20:34:48.728ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
48912024-10-31T20:34:48.728ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "41b9bcbf-a577-4feb-9a3f-3e060c06d196", "content-length": "26", "date": "Thu, 31 Oct 2024 20:34:47 GMT"} })
48922024-10-31T20:34:48.728ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
48932024-10-31T20:34:48.730ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
48942024-10-31T20:34:48.736ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 zone_address = fd00:1122:3344:101::2
48952024-10-31T20:34:48.736ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
48962024-10-31T20:34:48.736ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "34364908-8a8a-49d4-995a-bc2ecc9caac2", "content-length": "26", "date": "Thu, 31 Oct 2024 20:34:47 GMT"} })
48972024-10-31T20:34:48.736ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
48982024-10-31T20:34:48.738ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439
48992024-10-31T20:34:48.749ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49002024-10-31T20:34:48.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49012024-10-31T20:34:48.758ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
49022024-10-31T20:34:48.758ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
49032024-10-31T20:34:48.758ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 115.009408ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
49042024-10-31T20:34:48.790ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 148.16757ms iteration = 32 status = {"physical_disks_added":0}
49052024-10-31T20:34:48.826ZINFOnexus (BackgroundTasks): VPC route manager sled 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
49062024-10-31T20:34:48.826ZDEBGnexus (BackgroundTasks): client request SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
49072024-10-31T20:34:48.827ZDEBGnexus (BackgroundTasks): client response SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "29877ace-b7c7-4d10-b6d3-a7251447fdbd", "content-length": "372", "date": "Thu, 31 Oct 2024 20:34:48 GMT"} })
49082024-10-31T20:34:48.827ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49092024-10-31T20:34:48.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49102024-10-31T20:34:48.874ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
49112024-10-31T20:34:48.874ZDEBGnexus (BackgroundTasks): client request SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
49122024-10-31T20:34:48.875ZDEBGnexus (BackgroundTasks): client response SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "76232aa6-51ca-4902-a19f-dc14bbadbfde", "date": "Thu, 31 Oct 2024 20:34:48 GMT"} })
49132024-10-31T20:34:48.875ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49142024-10-31T20:34:48.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49152024-10-31T20:34:48.877ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49162024-10-31T20:34:48.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49172024-10-31T20:34:48.882ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49182024-10-31T20:34:48.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49192024-10-31T20:34:48.888ZINFOnexus (BackgroundTasks): VPC route manager sled 622abb78-eb68-41c1-ac52-e7a263024e57 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
49202024-10-31T20:34:48.888ZDEBGnexus (BackgroundTasks): client request SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
49212024-10-31T20:34:48.889ZDEBGnexus (BackgroundTasks): client response SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "41299067-0565-4464-ba34-511a07d15716", "date": "Thu, 31 Oct 2024 20:34:48 GMT"} })
49222024-10-31T20:34:48.890ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 246.883522ms iteration = 30 status = {}
49232024-10-31T20:34:48.903ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49242024-10-31T20:34:48.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49252024-10-31T20:34:48.924ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 282.226542ms iteration = 28 status = {}
49262024-10-31T20:34:48.927ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
49272024-10-31T20:34:48.928ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "cb79e5b5-ff5b-48b4-b008-c9ebb3b6999f", "content-length": "2", "date": "Thu, 31 Oct 2024 20:34:48 GMT"} })
49282024-10-31T20:34:48.929ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
49292024-10-31T20:34:48.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
49302024-10-31T20:34:48.931ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 289.143824ms iteration = 28 status = null
49312024-10-31T20:34:48.935ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49322024-10-31T20:34:48.937ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
49332024-10-31T20:34:48.937ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49342024-10-31T20:34:48.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49352024-10-31T20:34:48.958ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49362024-10-31T20:34:48.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49372024-10-31T20:34:48.960ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2c0ce4ae-e332-4e80-bd64-c2d6cfd99f8f, rack_id: cf9a2d24-88ed-47a2-a402-0cbbba2d1439, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(1479dccf-28ea-4cc0-9964-818390bddf17) } rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 switch_location = Switch0
49382024-10-31T20:34:48.960ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49392024-10-31T20:34:48.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49402024-10-31T20:34:48.965ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49412024-10-31T20:34:48.966ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
49422024-10-31T20:34:48.966ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49432024-10-31T20:34:48.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49442024-10-31T20:34:48.971ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
49452024-10-31T20:34:48.971ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "d39c4e60-3909-4273-b712-a7515868e0d4", "content-length": "121", "date": "Thu, 31 Oct 2024 20:34:48 GMT"} })
49462024-10-31T20:34:48.972ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
49472024-10-31T20:34:48.972ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 1479dccf-28ea-4cc0-9964-818390bddf17
49482024-10-31T20:34:48.972ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
49492024-10-31T20:34:48.972ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
49502024-10-31T20:34:48.972ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
49512024-10-31T20:34:48.972ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
49522024-10-31T20:34:48.972ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
49532024-10-31T20:34:48.972ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
49542024-10-31T20:34:48.972ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
49552024-10-31T20:34:48.972ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
49562024-10-31T20:34:48.972ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439
49572024-10-31T20:34:48.972ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49582024-10-31T20:34:48.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49592024-10-31T20:34:48.974ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
49602024-10-31T20:34:48.974ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "328cd645-fa2d-4f48-9ef8-8a3166acf2cf", "content-length": "2", "date": "Thu, 31 Oct 2024 20:34:48 GMT"} })
49612024-10-31T20:34:48.974ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
49622024-10-31T20:34:48.974ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "41f9141e-31bd-436b-85b6-5d5b3921cff1", "content-length": "52", "date": "Thu, 31 Oct 2024 20:34:48 GMT"} })
49632024-10-31T20:34:48.974ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 switch_location = Switch0
49642024-10-31T20:34:48.974ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
49652024-10-31T20:34:48.999ZDEBGnexus (BackgroundTasks): client request SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
49662024-10-31T20:34:49.108ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "48df0907-bce3-46b3-bac5-bdb3e35399f5", "date": "Thu, 31 Oct 2024 20:34:48 GMT"} })
49672024-10-31T20:34:49.108ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 switch = Switch0
49682024-10-31T20:34:49.108ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
49692024-10-31T20:34:49.108ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "86028a9e-e81b-45da-af97-025cf7976568", "content-length": "669", "date": "Thu, 31 Oct 2024 20:34:49 GMT"} })
49702024-10-31T20:34:49.108ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49712024-10-31T20:34:49.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49722024-10-31T20:34:49.109ZDEBGnexus (BackgroundTasks): client response SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "83b273a3-0e73-4f2d-9fd0-54d630389738", "content-length": "691", "date": "Thu, 31 Oct 2024 20:34:49 GMT"} })
49732024-10-31T20:34:49.109ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
49742024-10-31T20:34:49.109ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
49752024-10-31T20:34:49.109ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
49762024-10-31T20:34:49.112ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 469.741473ms iteration = 29 status = {}
49772024-10-31T20:34:49.113ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49782024-10-31T20:34:49.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49792024-10-31T20:34:49.116ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49802024-10-31T20:34:49.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49812024-10-31T20:34:49.118ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49822024-10-31T20:34:49.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49832024-10-31T20:34:49.125ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 483.344582ms iteration = 28 status = {}
49842024-10-31T20:34:49.329ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 92b10968-b209-45cc-9a64-64d4058756f2 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
49852024-10-31T20:34:49.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 92b10968-b209-45cc-9a64-64d4058756f2 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
49862024-10-31T20:34:49.332ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2227 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 92b10968-b209-45cc-9a64-64d4058756f2 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
49872024-10-31T20:34:50.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 58f8b1de-982a-4cdb-8945-5c077005877a roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
49882024-10-31T20:34:50.357ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 58f8b1de-982a-4cdb-8945-5c077005877a resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
49892024-10-31T20:34:50.359ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2338 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 58f8b1de-982a-4cdb-8945-5c077005877a response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
49902024-10-31T20:34:51.380ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 224c00ff-e7ca-4c2c-9b2c-5041eb237b6f roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
49912024-10-31T20:34:51.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 224c00ff-e7ca-4c2c-9b2c-5041eb237b6f resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
49922024-10-31T20:34:51.383ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2462 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 224c00ff-e7ca-4c2c-9b2c-5041eb237b6f response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
49932024-10-31T20:34:52.405ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 2e4e70ef-2fd5-46f2-b89a-e3a0759e0d10 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
49942024-10-31T20:34:52.405ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 2e4e70ef-2fd5-46f2-b89a-e3a0759e0d10 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
49952024-10-31T20:34:52.407ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2905 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 2e4e70ef-2fd5-46f2-b89a-e3a0759e0d10 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
49962024-10-31T20:34:52.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = 4332e660-08ec-4c8d-8e8a-763808497657 roles = RoleSet { roles: {} } uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?sort_by=id_ascending
49972024-10-31T20:34:52.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = 4332e660-08ec-4c8d-8e8a-763808497657 resource = Database result = Ok(()) uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?sort_by=id_ascending
49982024-10-31T20:34:52.820ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3248 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = 4332e660-08ec-4c8d-8e8a-763808497657 response_code = 200 uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?sort_by=id_ascending
49992024-10-31T20:34:52.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = 2807ab99-8600-46bb-8fcc-c82b9b1f170c roles = RoleSet { roles: {} } uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzA4NDI3Ny1iNmFhLTQ1OWYtOGY4MS1mNGVmNGM3Yzg0M2UifX0%3D
50002024-10-31T20:34:52.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = 2807ab99-8600-46bb-8fcc-c82b9b1f170c resource = Database result = Ok(()) uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzA4NDI3Ny1iNmFhLTQ1OWYtOGY4MS1mNGVmNGM3Yzg0M2UifX0%3D
50012024-10-31T20:34:52.823ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2143 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = 2807ab99-8600-46bb-8fcc-c82b9b1f170c response_code = 200 uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzA4NDI3Ny1iNmFhLTQ1OWYtOGY4MS1mNGVmNGM3Yzg0M2UifX0%3D
50022024-10-31T20:34:53.431ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 980735bd-133f-4912-a3f2-66650647c09f roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
50032024-10-31T20:34:53.431ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 980735bd-133f-4912-a3f2-66650647c09f resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
50042024-10-31T20:34:53.433ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3005 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 980735bd-133f-4912-a3f2-66650647c09f response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
50052024-10-31T20:34:54.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 9c4ebcc2-5c37-4d50-b03a-8282c5cd9138 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
50062024-10-31T20:34:54.455ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 9c4ebcc2-5c37-4d50-b03a-8282c5cd9138 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
50072024-10-31T20:34:54.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2173 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 9c4ebcc2-5c37-4d50-b03a-8282c5cd9138 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
50082024-10-31T20:34:55.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 15cfe14b-578e-4280-927c-3769e4d6563d roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
50092024-10-31T20:34:55.479ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 15cfe14b-578e-4280-927c-3769e4d6563d resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
50102024-10-31T20:34:55.482ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2561 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 15cfe14b-578e-4280-927c-3769e4d6563d response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
50112024-10-31T20:34:56.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = b21b01bd-5944-4142-ac32-7280525ad395 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
50122024-10-31T20:34:56.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = b21b01bd-5944-4142-ac32-7280525ad395 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
50132024-10-31T20:34:56.505ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2468 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = b21b01bd-5944-4142-ac32-7280525ad395 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
50142024-10-31T20:34:57.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 7e975fb9-de11-4c1f-8927-606838b79906 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
50152024-10-31T20:34:57.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 7e975fb9-de11-4c1f-8927-606838b79906 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
50162024-10-31T20:34:57.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1802 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 7e975fb9-de11-4c1f-8927-606838b79906 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
50172024-10-31T20:34:58.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = efc2802c-bff1-44ad-95d7-0d4eee5a94df roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
50182024-10-31T20:34:58.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = efc2802c-bff1-44ad-95d7-0d4eee5a94df resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
50192024-10-31T20:34:58.552ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2108 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = efc2802c-bff1-44ad-95d7-0d4eee5a94df response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
50202024-10-31T20:34:58.642ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 83 reason = Timeout
50212024-10-31T20:34:58.642ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50222024-10-31T20:34:58.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50232024-10-31T20:34:58.643ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 83 reason = Timeout
50242024-10-31T20:34:58.643ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50252024-10-31T20:34:58.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50262024-10-31T20:34:58.672ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50272024-10-31T20:34:58.672ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50282024-10-31T20:34:58.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50292024-10-31T20:34:58.674ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.911842ms iteration = 83 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
50302024-10-31T20:34:58.674ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
50312024-10-31T20:34:58.674ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50322024-10-31T20:34:58.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50332024-10-31T20:34:58.677ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50342024-10-31T20:34:58.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50352024-10-31T20:34:58.705ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50362024-10-31T20:34:58.708ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 56b527e7-66b3-4602-a305-5dc763e7fb8b, lookup_type: ById(56b527e7-66b3-4602-a305-5dc763e7fb8b) } result = Ok(())
50372024-10-31T20:34:58.708ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50382024-10-31T20:34:58.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50392024-10-31T20:34:58.719ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b original_time_created = 2024-10-31 20:20:56.758465 UTC target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b time_created = 2024-10-31 20:20:56.758465 UTC
50402024-10-31T20:34:58.719ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 76.504822ms iteration = 83 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"56b527e7-66b3-4602-a305-5dc763e7fb8b","time_created":"2024-10-31T20:20:56.758465Z"}
50412024-10-31T20:34:59.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 7c37980d-1a5f-42ea-a317-03c3516b789f roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
50422024-10-31T20:34:59.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 7c37980d-1a5f-42ea-a317-03c3516b789f resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
50432024-10-31T20:34:59.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2514 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 7c37980d-1a5f-42ea-a317-03c3516b789f response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
50442024-10-31T20:35:00.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 55ef0d02-13d8-40b2-bfec-a8168f7b29de roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
50452024-10-31T20:35:00.599ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 55ef0d02-13d8-40b2-bfec-a8168f7b29de resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
50462024-10-31T20:35:00.601ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2877 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 55ef0d02-13d8-40b2-bfec-a8168f7b29de response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
50472024-10-31T20:35:01.623ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 37ace198-2f2a-479d-aa63-38b5d62bf0b6 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
50482024-10-31T20:35:01.623ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 37ace198-2f2a-479d-aa63-38b5d62bf0b6 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
50492024-10-31T20:35:01.624ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1877 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 37ace198-2f2a-479d-aa63-38b5d62bf0b6 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
50502024-10-31T20:35:02.646ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = d0b962f3-f14d-4b40-b2dd-4839c46dcda6 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
50512024-10-31T20:35:02.647ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = d0b962f3-f14d-4b40-b2dd-4839c46dcda6 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
50522024-10-31T20:35:02.649ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2452 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = d0b962f3-f14d-4b40-b2dd-4839c46dcda6 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
50532024-10-31T20:35:02.826ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1327 local_addr = [fd00:1122:3344:101::c]:63183 method = GET remote_addr = [fd00:1122:3344:101::d]:38560 req_id = 8a30ef1f-72f6-4dd8-9b3b-c59308db18c4 response_code = 200 uri = /d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
50542024-10-31T20:35:03.672ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 93809de4-d611-415a-ae3f-5600e6a317fc roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
50552024-10-31T20:35:03.672ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 93809de4-d611-415a-ae3f-5600e6a317fc resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
50562024-10-31T20:35:03.674ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2192 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 93809de4-d611-415a-ae3f-5600e6a317fc response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
50572024-10-31T20:35:04.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 03a0c831-5707-463a-bbab-5aa633c407bc roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
50582024-10-31T20:35:04.696ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 03a0c831-5707-463a-bbab-5aa633c407bc resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
50592024-10-31T20:35:04.698ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2373 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 03a0c831-5707-463a-bbab-5aa633c407bc response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
50602024-10-31T20:35:05.720ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 7aa7ea72-86ec-46ae-97f0-61f7d84700ef roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
50612024-10-31T20:35:05.720ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 7aa7ea72-86ec-46ae-97f0-61f7d84700ef resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
50622024-10-31T20:35:05.722ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2430 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 7aa7ea72-86ec-46ae-97f0-61f7d84700ef response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
50632024-10-31T20:35:06.744ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 88666188-0151-4759-9678-dc88eb89bcfc roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
50642024-10-31T20:35:06.744ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 88666188-0151-4759-9678-dc88eb89bcfc resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
50652024-10-31T20:35:06.745ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1746 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 88666188-0151-4759-9678-dc88eb89bcfc response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
50662024-10-31T20:35:07.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = e4545ff1-dc80-4395-86d8-8039656ce2f2 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
50672024-10-31T20:35:07.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = e4545ff1-dc80-4395-86d8-8039656ce2f2 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
50682024-10-31T20:35:07.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2455 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = e4545ff1-dc80-4395-86d8-8039656ce2f2 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
50692024-10-31T20:35:07.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = 889a8622-3c49-47e5-bcb7-f50d82e091ce roles = RoleSet { roles: {} } uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?sort_by=id_ascending
50702024-10-31T20:35:07.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = 889a8622-3c49-47e5-bcb7-f50d82e091ce resource = Database result = Ok(()) uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?sort_by=id_ascending
50712024-10-31T20:35:07.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3234 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = 889a8622-3c49-47e5-bcb7-f50d82e091ce response_code = 200 uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?sort_by=id_ascending
50722024-10-31T20:35:07.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = bdcad3cc-f751-4cae-b605-e7d3fd9bcd0b roles = RoleSet { roles: {} } uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzA4NDI3Ny1iNmFhLTQ1OWYtOGY4MS1mNGVmNGM3Yzg0M2UifX0%3D
50732024-10-31T20:35:07.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = bdcad3cc-f751-4cae-b605-e7d3fd9bcd0b resource = Database result = Ok(()) uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzA4NDI3Ny1iNmFhLTQ1OWYtOGY4MS1mNGVmNGM3Yzg0M2UifX0%3D
50742024-10-31T20:35:07.823ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2514 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = bdcad3cc-f751-4cae-b605-e7d3fd9bcd0b response_code = 200 uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzA4NDI3Ny1iNmFhLTQ1OWYtOGY4MS1mNGVmNGM3Yzg0M2UifX0%3D
50752024-10-31T20:35:08.642ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 84 reason = Timeout
50762024-10-31T20:35:08.642ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50772024-10-31T20:35:08.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50782024-10-31T20:35:08.643ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 84 reason = Timeout
50792024-10-31T20:35:08.643ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50802024-10-31T20:35:08.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50812024-10-31T20:35:08.644ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50822024-10-31T20:35:08.645ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50832024-10-31T20:35:08.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50842024-10-31T20:35:08.647ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
50852024-10-31T20:35:08.647ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50862024-10-31T20:35:08.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50872024-10-31T20:35:08.649ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50882024-10-31T20:35:08.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50892024-10-31T20:35:08.651ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50902024-10-31T20:35:08.653ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 56b527e7-66b3-4602-a305-5dc763e7fb8b, lookup_type: ById(56b527e7-66b3-4602-a305-5dc763e7fb8b) } result = Ok(())
50912024-10-31T20:35:08.653ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50922024-10-31T20:35:08.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50932024-10-31T20:35:08.664ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b original_time_created = 2024-10-31 20:20:56.758465 UTC target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b time_created = 2024-10-31 20:20:56.758465 UTC
50942024-10-31T20:35:08.664ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.377943ms iteration = 84 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"56b527e7-66b3-4602-a305-5dc763e7fb8b","time_created":"2024-10-31T20:20:56.758465Z"}
50952024-10-31T20:35:08.672ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.235713ms iteration = 84 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
50962024-10-31T20:35:08.791ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = cfb20d69-7ee4-43dc-baa9-b1d7d876590e roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
50972024-10-31T20:35:08.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = cfb20d69-7ee4-43dc-baa9-b1d7d876590e resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
50982024-10-31T20:35:08.793ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1867 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = cfb20d69-7ee4-43dc-baa9-b1d7d876590e response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
50992024-10-31T20:35:09.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = b7274b64-7872-45b6-aeea-19e631eb3554 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
51002024-10-31T20:35:09.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = b7274b64-7872-45b6-aeea-19e631eb3554 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
51012024-10-31T20:35:09.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2610 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = b7274b64-7872-45b6-aeea-19e631eb3554 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
51022024-10-31T20:35:10.839ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = b73975ce-c133-46cc-8da0-4006d12f8238 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
51032024-10-31T20:35:10.839ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = b73975ce-c133-46cc-8da0-4006d12f8238 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
51042024-10-31T20:35:10.841ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2372 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = b73975ce-c133-46cc-8da0-4006d12f8238 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
51052024-10-31T20:35:11.862ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 4bcd6b22-ed7a-455a-93d7-0fa6a2fce2c2 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
51062024-10-31T20:35:11.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 4bcd6b22-ed7a-455a-93d7-0fa6a2fce2c2 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
51072024-10-31T20:35:11.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2750 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 4bcd6b22-ed7a-455a-93d7-0fa6a2fce2c2 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
51082024-10-31T20:35:12.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 67dd0218-64b6-4193-b285-730bd398f91d roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
51092024-10-31T20:35:12.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 67dd0218-64b6-4193-b285-730bd398f91d resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
51102024-10-31T20:35:12.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2551 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 67dd0218-64b6-4193-b285-730bd398f91d response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
51112024-10-31T20:35:13.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = c33b5eb8-accc-4653-ae82-a3e4d8df05c6 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
51122024-10-31T20:35:13.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = c33b5eb8-accc-4653-ae82-a3e4d8df05c6 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
51132024-10-31T20:35:13.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2377 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = c33b5eb8-accc-4653-ae82-a3e4d8df05c6 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
51142024-10-31T20:35:14.370ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46541 req_id = 3fef53e3-b007-4eb5-bd77-bb5a39124601 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
51152024-10-31T20:35:14.371ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46541 req_id = 3fef53e3-b007-4eb5-bd77-bb5a39124601 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
51162024-10-31T20:35:14.374ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3731 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46541 req_id = 3fef53e3-b007-4eb5-bd77-bb5a39124601 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
51172024-10-31T20:35:14.935ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = ab0832bd-6f45-432f-9187-9493101bc8c6 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
51182024-10-31T20:35:14.935ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = ab0832bd-6f45-432f-9187-9493101bc8c6 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
51192024-10-31T20:35:14.937ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2067 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = ab0832bd-6f45-432f-9187-9493101bc8c6 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
51202024-10-31T20:35:15.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = bcd2d273-8054-4288-97c7-9802e069ae12 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
51212024-10-31T20:35:15.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = bcd2d273-8054-4288-97c7-9802e069ae12 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
51222024-10-31T20:35:15.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2373 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = bcd2d273-8054-4288-97c7-9802e069ae12 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
51232024-10-31T20:35:16.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 1f60ee8c-2713-40de-b2e9-f1efc31cd88f roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
51242024-10-31T20:35:16.986ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 1f60ee8c-2713-40de-b2e9-f1efc31cd88f resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
51252024-10-31T20:35:16.988ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2588 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 1f60ee8c-2713-40de-b2e9-f1efc31cd88f response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
51262024-10-31T20:35:17.826ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1293 local_addr = [fd00:1122:3344:101::c]:63183 method = GET remote_addr = [fd00:1122:3344:101::d]:38560 req_id = 238b8607-f57e-40d9-9c90-bac67ef60b77 response_code = 200 uri = /d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
51272024-10-31T20:35:18.011ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = ac0be50f-958a-47d7-9e95-1c615e7023d3 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
51282024-10-31T20:35:18.011ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = ac0be50f-958a-47d7-9e95-1c615e7023d3 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
51292024-10-31T20:35:18.013ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2352 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = ac0be50f-958a-47d7-9e95-1c615e7023d3 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
51302024-10-31T20:35:18.642ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 15 reason = Timeout
51312024-10-31T20:35:18.642ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-10-31 20:25:18.642521592 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
51322024-10-31T20:35:18.642ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
51332024-10-31T20:35:18.642ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 85 reason = Timeout
51342024-10-31T20:35:18.642ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 30 reason = Timeout
51352024-10-31T20:35:18.642ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51362024-10-31T20:35:18.642ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51372024-10-31T20:35:18.642ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 16 reason = Timeout
51382024-10-31T20:35:18.642ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 29 reason = Timeout
51392024-10-31T20:35:18.642ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51402024-10-31T20:35:18.642ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 29 reason = Timeout
51412024-10-31T20:35:18.642ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
51422024-10-31T20:35:18.642ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 29 reason = Timeout
51432024-10-31T20:35:18.642ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 33 reason = Timeout
51442024-10-31T20:35:18.642ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51452024-10-31T20:35:18.642ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51462024-10-31T20:35:18.642ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 15 reason = Timeout
51472024-10-31T20:35:18.642ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
51482024-10-31T20:35:18.642ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
51492024-10-31T20:35:18.642ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 17 reason = Timeout
51502024-10-31T20:35:18.642ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 16 reason = Timeout
51512024-10-31T20:35:18.642ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
51522024-10-31T20:35:18.642ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
51532024-10-31T20:35:18.642ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 16 reason = Timeout
51542024-10-31T20:35:18.642ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 17 reason = Timeout
51552024-10-31T20:35:18.642ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 16 reason = Timeout
51562024-10-31T20:35:18.642ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b
51572024-10-31T20:35:18.642ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.11\u{b5}s iteration = 16 status = {"enabled":false,"target_id":"56b527e7-66b3-4602-a305-5dc763e7fb8b"}
51582024-10-31T20:35:18.642ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 16 reason = Timeout
51592024-10-31T20:35:18.642ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
51602024-10-31T20:35:18.642ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 29 reason = Timeout
51612024-10-31T20:35:18.642ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 16 reason = Timeout
51622024-10-31T20:35:18.642ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
51632024-10-31T20:35:18.642ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51642024-10-31T20:35:18.642ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 29 reason = Timeout
51652024-10-31T20:35:18.642ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
51662024-10-31T20:35:18.642ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 29 reason = Timeout
51672024-10-31T20:35:18.642ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
51682024-10-31T20:35:18.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51692024-10-31T20:35:18.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
51702024-10-31T20:35:18.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51712024-10-31T20:35:18.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51722024-10-31T20:35:18.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
51732024-10-31T20:35:18.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51742024-10-31T20:35:18.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
51752024-10-31T20:35:18.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51762024-10-31T20:35:18.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51772024-10-31T20:35:18.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
51782024-10-31T20:35:18.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
51792024-10-31T20:35:18.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51802024-10-31T20:35:18.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
51812024-10-31T20:35:18.643ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 29 reason = Timeout
51822024-10-31T20:35:18.643ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 29 reason = Timeout
51832024-10-31T20:35:18.643ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
51842024-10-31T20:35:18.643ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 7.68\u{b5}s iteration = 29 status = {"errors":[],"garbage_collect_requested":[]}
51852024-10-31T20:35:18.643ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 29 reason = Timeout
51862024-10-31T20:35:18.643ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
51872024-10-31T20:35:18.643ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 15 reason = Timeout
51882024-10-31T20:35:18.643ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
51892024-10-31T20:35:18.643ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
51902024-10-31T20:35:18.643ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 29 reason = Timeout
51912024-10-31T20:35:18.643ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("02376501-3235-4cfe-a1cd-82b53358d277.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a8364658-9f18-48ec-a891-264e5c9fbbb6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("a8364658-9f18-48ec-a891-264e5c9fbbb6.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1831, tv_nsec: 298346896 } })
51922024-10-31T20:35:18.643ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 8.47\u{b5}s iteration = 29 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
51932024-10-31T20:35:18.643ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 29 reason = Timeout
51942024-10-31T20:35:18.643ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 15 reason = Timeout
51952024-10-31T20:35:18.643ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 5.98\u{b5}s iteration = 29 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
51962024-10-31T20:35:18.643ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 85 reason = Timeout
51972024-10-31T20:35:18.643ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
51982024-10-31T20:35:18.643ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51992024-10-31T20:35:18.643ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 29 reason = Timeout
52002024-10-31T20:35:18.643ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.5\u{b5}s iteration = 29 status = {"errors":[],"records_set_to_done":[]}
52012024-10-31T20:35:18.643ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 31 reason = Timeout
52022024-10-31T20:35:18.643ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 15 reason = Timeout
52032024-10-31T20:35:18.643ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
52042024-10-31T20:35:18.643ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52052024-10-31T20:35:18.643ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
52062024-10-31T20:35:18.643ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8e750a05-d6dd-412d-aac1-b776b5e7757f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8e764cc9-00d9-46ed-80f0-316c9e4e0a2b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f87fba37-8eb7-413a-91fe-8caa94515963.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f87fba37-8eb7-413a-91fe-8caa94515963.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1831, tv_nsec: 298474758 } })
52072024-10-31T20:35:18.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
52082024-10-31T20:35:18.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
52092024-10-31T20:35:18.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
52102024-10-31T20:35:18.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52112024-10-31T20:35:18.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52122024-10-31T20:35:18.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
52132024-10-31T20:35:18.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
52142024-10-31T20:35:18.643ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
52152024-10-31T20:35:18.643ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.127449ms iteration = 16 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
52162024-10-31T20:35:18.643ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
52172024-10-31T20:35:18.643ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.401365ms iteration = 16 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
52182024-10-31T20:35:18.646ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-10-31 20:25:18.642521592 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
52192024-10-31T20:35:18.646ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.054241ms iteration = 15 status = {"expiration":"2024-10-31T20:25:18.642521592Z","pruned":[]}
52202024-10-31T20:35:18.646ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52212024-10-31T20:35:18.647ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52222024-10-31T20:35:18.647ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.593161ms iteration = 29 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
52232024-10-31T20:35:18.648ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52242024-10-31T20:35:18.650ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
52252024-10-31T20:35:18.650ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52262024-10-31T20:35:18.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52272024-10-31T20:35:18.650ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52282024-10-31T20:35:18.650ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52292024-10-31T20:35:18.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52302024-10-31T20:35:18.651ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52312024-10-31T20:35:18.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
52322024-10-31T20:35:18.651ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
52332024-10-31T20:35:18.651ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52342024-10-31T20:35:18.651ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52352024-10-31T20:35:18.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52362024-10-31T20:35:18.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52372024-10-31T20:35:18.653ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1831, tv_nsec: 308439313 } })
52382024-10-31T20:35:18.653ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
52392024-10-31T20:35:18.655ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 11.851398ms iteration = 15 status = {"errors":[],"found_port_ok":[]}
52402024-10-31T20:35:18.657ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1831, tv_nsec: 312703788 } })
52412024-10-31T20:35:18.658ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52422024-10-31T20:35:18.658ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
52432024-10-31T20:35:18.658ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52442024-10-31T20:35:18.658ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1831, tv_nsec: 313410490 } })
52452024-10-31T20:35:18.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52462024-10-31T20:35:18.658ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439
52472024-10-31T20:35:18.659ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52482024-10-31T20:35:18.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52492024-10-31T20:35:18.662ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
52502024-10-31T20:35:18.664ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52512024-10-31T20:35:18.668ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 56b527e7-66b3-4602-a305-5dc763e7fb8b, lookup_type: ById(56b527e7-66b3-4602-a305-5dc763e7fb8b) } result = Ok(())
52522024-10-31T20:35:18.668ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52532024-10-31T20:35:18.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52542024-10-31T20:35:18.685ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b original_time_created = 2024-10-31 20:20:56.758465 UTC target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b time_created = 2024-10-31 20:20:56.758465 UTC
52552024-10-31T20:35:18.685ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 42.774281ms iteration = 85 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"56b527e7-66b3-4602-a305-5dc763e7fb8b","time_created":"2024-10-31T20:20:56.758465Z"}
52562024-10-31T20:35:18.686ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52572024-10-31T20:35:18.689ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
52582024-10-31T20:35:18.689ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
52592024-10-31T20:35:18.689ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
52602024-10-31T20:35:18.689ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
52612024-10-31T20:35:18.689ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52622024-10-31T20:35:18.689ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52632024-10-31T20:35:18.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
52642024-10-31T20:35:18.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
52652024-10-31T20:35:18.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52662024-10-31T20:35:18.691ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52672024-10-31T20:35:18.691ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52682024-10-31T20:35:18.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
52692024-10-31T20:35:18.692ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52702024-10-31T20:35:18.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52712024-10-31T20:35:18.693ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52722024-10-31T20:35:18.693ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52732024-10-31T20:35:18.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52742024-10-31T20:35:18.693ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52752024-10-31T20:35:18.694ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
52762024-10-31T20:35:18.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
52772024-10-31T20:35:18.695ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52782024-10-31T20:35:18.696ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
52792024-10-31T20:35:18.697ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
52802024-10-31T20:35:18.697ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
52812024-10-31T20:35:18.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
52822024-10-31T20:35:18.697ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
52832024-10-31T20:35:18.697ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52842024-10-31T20:35:18.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52852024-10-31T20:35:18.698ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
52862024-10-31T20:35:18.698ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
52872024-10-31T20:35:18.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
52882024-10-31T20:35:18.698ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52892024-10-31T20:35:18.699ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
52902024-10-31T20:35:18.699ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
52912024-10-31T20:35:18.699ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 56.186985ms iteration = 15 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
52922024-10-31T20:35:18.699ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 57.321766ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
52932024-10-31T20:35:18.700ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52942024-10-31T20:35:18.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52952024-10-31T20:35:18.701ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
52962024-10-31T20:35:18.701ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52972024-10-31T20:35:18.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52982024-10-31T20:35:18.702ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52992024-10-31T20:35:18.702ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53002024-10-31T20:35:18.703ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
53012024-10-31T20:35:18.703ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
53022024-10-31T20:35:18.703ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
53032024-10-31T20:35:18.703ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53042024-10-31T20:35:18.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53052024-10-31T20:35:18.704ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
53062024-10-31T20:35:18.705ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53072024-10-31T20:35:18.705ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53082024-10-31T20:35:18.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53092024-10-31T20:35:18.705ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
53102024-10-31T20:35:18.705ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53112024-10-31T20:35:18.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53122024-10-31T20:35:18.707ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
53132024-10-31T20:35:18.707ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53142024-10-31T20:35:18.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53152024-10-31T20:35:18.723ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
53162024-10-31T20:35:18.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
53172024-10-31T20:35:18.730ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53182024-10-31T20:35:18.730ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53192024-10-31T20:35:18.734ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
53202024-10-31T20:35:18.734ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
53212024-10-31T20:35:18.734ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 91.376793ms iteration = 15 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
53222024-10-31T20:35:18.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
53232024-10-31T20:35:18.734ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
53242024-10-31T20:35:18.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
53252024-10-31T20:35:18.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 622abb78-eb68-41c1-ac52-e7a263024e57, lookup_type: ById(622abb78-eb68-41c1-ac52-e7a263024e57) } result = Ok(())
53262024-10-31T20:35:18.734ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53272024-10-31T20:35:18.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53282024-10-31T20:35:18.735ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
53292024-10-31T20:35:18.735ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
53302024-10-31T20:35:18.735ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53312024-10-31T20:35:18.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
53322024-10-31T20:35:18.738ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 94.906986ms iteration = 85 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
53332024-10-31T20:35:18.744ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
53342024-10-31T20:35:18.744ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 101.359589ms iteration = 29 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
53352024-10-31T20:35:18.745ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
53362024-10-31T20:35:18.745ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
53372024-10-31T20:35:18.746ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
53382024-10-31T20:35:18.746ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53392024-10-31T20:35:18.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53402024-10-31T20:35:18.756ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
53412024-10-31T20:35:18.756ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 1a5173f7-64b4-48db-9160-caa5913594e3 dns_zone_name = oxide.test found_so_far = 0 version = 2
53422024-10-31T20:35:18.756ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53432024-10-31T20:35:18.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53442024-10-31T20:35:18.769ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53452024-10-31T20:35:18.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53462024-10-31T20:35:18.785ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
53472024-10-31T20:35:18.804ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 161.682247ms iteration = 33 status = {"physical_disks_added":0}
53482024-10-31T20:35:18.834ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 zone_address = fd00:1122:3344:101::2
53492024-10-31T20:35:18.834ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
53502024-10-31T20:35:18.834ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "be710b09-0719-45ff-8804-98619408d6aa", "content-length": "26", "date": "Thu, 31 Oct 2024 20:35:18 GMT"} })
53512024-10-31T20:35:18.834ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
53522024-10-31T20:35:18.837ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439
53532024-10-31T20:35:18.839ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
53542024-10-31T20:35:18.839ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
53552024-10-31T20:35:18.839ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a75ec77-981d-407f-87f7-00bc4392bdb3", "content-length": "26", "date": "Thu, 31 Oct 2024 20:35:18 GMT"} })
53562024-10-31T20:35:18.839ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
53572024-10-31T20:35:18.841ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
53582024-10-31T20:35:18.942ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
53592024-10-31T20:35:18.988ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
53602024-10-31T20:35:19.009ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
53612024-10-31T20:35:19.009ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
53622024-10-31T20:35:19.010ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd35e119-a096-49b3-bd62-a7eece02b86b", "content-length": "26", "date": "Thu, 31 Oct 2024 20:35:18 GMT"} })
53632024-10-31T20:35:19.010ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
53642024-10-31T20:35:19.011ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
53652024-10-31T20:35:19.025ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
53662024-10-31T20:35:19.025ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "1b8eacf1-ae36-4314-8ec1-afad841a9038", "content-length": "2", "date": "Thu, 31 Oct 2024 20:35:18 GMT"} })
53672024-10-31T20:35:19.027ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
53682024-10-31T20:35:19.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
53692024-10-31T20:35:19.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = e2bb40b8-432a-4ffd-aea1-7b5d4b12f0ea roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
53702024-10-31T20:35:19.035ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = e2bb40b8-432a-4ffd-aea1-7b5d4b12f0ea resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
53712024-10-31T20:35:19.093ZINFOnexus (BackgroundTasks): VPC route manager sled 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
53722024-10-31T20:35:19.093ZDEBGnexus (BackgroundTasks): client request SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
53732024-10-31T20:35:19.094ZDEBGnexus (BackgroundTasks): client response SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c69a2510-4569-4ae4-9342-e0b52746bd5f", "content-length": "372", "date": "Thu, 31 Oct 2024 20:35:19 GMT"} })
53742024-10-31T20:35:19.094ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53752024-10-31T20:35:19.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53762024-10-31T20:35:19.097ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
53772024-10-31T20:35:19.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
53782024-10-31T20:35:19.111ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 468.375029ms iteration = 29 status = 0
53792024-10-31T20:35:19.111ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53802024-10-31T20:35:19.116ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
53812024-10-31T20:35:19.116ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53822024-10-31T20:35:19.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53832024-10-31T20:35:19.120ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 477.271605ms iteration = 29 status = null
53842024-10-31T20:35:19.125ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 90491 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = e2bb40b8-432a-4ffd-aea1-7b5d4b12f0ea response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
53852024-10-31T20:35:19.126ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
53862024-10-31T20:35:19.126ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 9bbba0df-c792-4ba2-925b-ab02ed6483a1 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
53872024-10-31T20:35:19.126ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53882024-10-31T20:35:19.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53892024-10-31T20:35:19.130ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53902024-10-31T20:35:19.131ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53912024-10-31T20:35:19.135ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
53922024-10-31T20:35:19.135ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
53932024-10-31T20:35:19.135ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
53942024-10-31T20:35:19.135ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53952024-10-31T20:35:19.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
53962024-10-31T20:35:19.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53972024-10-31T20:35:19.136ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
53982024-10-31T20:35:19.136ZDEBGnexus (BackgroundTasks): client request SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
53992024-10-31T20:35:19.139ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 9bbba0df-c792-4ba2-925b-ab02ed6483a1 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
54002024-10-31T20:35:19.139ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
54012024-10-31T20:35:19.139ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-10-31 20:21:21.652645 UTC dns_group = internal generation = 1
54022024-10-31T20:35:19.139ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 496.441631ms iteration = 16 status = {"generation":1}
54032024-10-31T20:35:19.140ZDEBGnexus (BackgroundTasks): client response SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "764806f6-fd23-4263-891e-819da4d53794", "date": "Thu, 31 Oct 2024 20:35:19 GMT"} })
54042024-10-31T20:35:19.140ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54052024-10-31T20:35:19.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54062024-10-31T20:35:19.143ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54072024-10-31T20:35:19.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54082024-10-31T20:35:19.146ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54092024-10-31T20:35:19.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54102024-10-31T20:35:19.148ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
54112024-10-31T20:35:19.149ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "224bceb7-bd10-46c7-b032-f27ac1e3a11d", "date": "Thu, 31 Oct 2024 20:35:19 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
54122024-10-31T20:35:19.149ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
54132024-10-31T20:35:19.151ZINFOnexus (BackgroundTasks): VPC route manager sled 622abb78-eb68-41c1-ac52-e7a263024e57 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
54142024-10-31T20:35:19.151ZDEBGnexus (BackgroundTasks): client request SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
54152024-10-31T20:35:19.151ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "c9d3efab-1a9b-449d-8584-5f5fc9853ff0", "date": "Thu, 31 Oct 2024 20:35:19 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
54162024-10-31T20:35:19.151ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
54172024-10-31T20:35:19.151ZDEBGnexus (BackgroundTasks): client response SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "eaa02107-9b0d-4816-bc24-efbbed2d99b3", "date": "Thu, 31 Oct 2024 20:35:19 GMT"} })
54182024-10-31T20:35:19.153ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54192024-10-31T20:35:19.153ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
54202024-10-31T20:35:19.153ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 511.302252ms iteration = 17 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
54212024-10-31T20:35:19.154ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 511.560136ms iteration = 31 status = {}
54222024-10-31T20:35:19.158ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
54232024-10-31T20:35:19.158ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
54242024-10-31T20:35:19.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
54252024-10-31T20:35:19.159ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
54262024-10-31T20:35:19.159ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
54272024-10-31T20:35:19.159ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 516.415512ms iteration = 29 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
54282024-10-31T20:35:19.164ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 1a5173f7-64b4-48db-9160-caa5913594e3 dns_zone_name = oxide.test found_so_far = 1 version = 2
54292024-10-31T20:35:19.164ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
54302024-10-31T20:35:19.164ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-10-31 20:21:23.098854 UTC dns_group = external generation = 2
54312024-10-31T20:35:19.164ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 521.828837ms iteration = 16 status = {"generation":2}
54322024-10-31T20:35:19.188ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-10-31T20:21:09.823788Z, time_modified: 2024-10-31T20:21:09.823788Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9efc5118-5ea4-4fe1-a8c5-501dee3e98c0, db_silo: Silo { identity: SiloIdentity { id: 9efc5118-5ea4-4fe1-a8c5-501dee3e98c0, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-31T20:21:23.039241Z, time_modified: 2024-10-31T20:21:23.039241Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "fffc2e5c59e415981668ee3af9418c2de014d1976b7a03713830fdf9f35a71e6" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9efc5118-5ea4-4fe1-a8c5-501dee3e98c0, db_silo: Silo { identity: SiloIdentity { id: 9efc5118-5ea4-4fe1-a8c5-501dee3e98c0, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-31T20:21:23.039241Z, time_modified: 2024-10-31T20:21:23.039241Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "fffc2e5c59e415981668ee3af9418c2de014d1976b7a03713830fdf9f35a71e6" }] }) }
54332024-10-31T20:35:19.188ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 545.990101ms iteration = 16 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9efc5118-5ea4-4fe1-a8c5-501dee3e98c0","tls_certs":["fffc2e5c59e415981668ee3af9418c2de014d1976b7a03713830fdf9f35a71e6"]}},"default_endpoint":{"silo_id":"9efc5118-5ea4-4fe1-a8c5-501dee3e98c0","tls_certs":["fffc2e5c59e415981668ee3af9418c2de014d1976b7a03713830fdf9f35a71e6"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
54342024-10-31T20:35:19.193ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
54352024-10-31T20:35:19.194ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "3ae3c305-ecf2-4708-8d2f-354f39e9ddc6", "date": "Thu, 31 Oct 2024 20:35:19 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
54362024-10-31T20:35:19.194ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
54372024-10-31T20:35:19.196ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "9d65f2c8-8535-447f-b32a-b55990c1fa33", "date": "Thu, 31 Oct 2024 20:35:19 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
54382024-10-31T20:35:19.196ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
54392024-10-31T20:35:19.197ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "2bf4911a-0d54-41c8-bdd1-5ee6fe88f2f8", "date": "Thu, 31 Oct 2024 20:35:19 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
54402024-10-31T20:35:19.197ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
54412024-10-31T20:35:19.199ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
54422024-10-31T20:35:19.199ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 556.944524ms iteration = 17 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
54432024-10-31T20:35:19.218ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 575.930006ms iteration = 29 status = {}
54442024-10-31T20:35:19.219ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
54452024-10-31T20:35:19.219ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 575.830394ms iteration = 15 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
54462024-10-31T20:35:19.233ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54472024-10-31T20:35:19.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54482024-10-31T20:35:19.235ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2c0ce4ae-e332-4e80-bd64-c2d6cfd99f8f, rack_id: cf9a2d24-88ed-47a2-a402-0cbbba2d1439, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(1479dccf-28ea-4cc0-9964-818390bddf17) } rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 switch_location = Switch0
54492024-10-31T20:35:19.235ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54502024-10-31T20:35:19.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54512024-10-31T20:35:19.237ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54522024-10-31T20:35:19.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54532024-10-31T20:35:19.239ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54542024-10-31T20:35:19.241ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
54552024-10-31T20:35:19.241ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54562024-10-31T20:35:19.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54572024-10-31T20:35:19.244ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
54582024-10-31T20:35:19.244ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "baac4781-bbd2-4dea-be38-55eb3cafa0bf", "content-length": "121", "date": "Thu, 31 Oct 2024 20:35:19 GMT"} })
54592024-10-31T20:35:19.244ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
54602024-10-31T20:35:19.244ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 1479dccf-28ea-4cc0-9964-818390bddf17
54612024-10-31T20:35:19.244ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
54622024-10-31T20:35:19.244ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
54632024-10-31T20:35:19.244ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
54642024-10-31T20:35:19.244ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
54652024-10-31T20:35:19.244ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
54662024-10-31T20:35:19.244ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
54672024-10-31T20:35:19.245ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
54682024-10-31T20:35:19.245ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
54692024-10-31T20:35:19.245ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439
54702024-10-31T20:35:19.245ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54712024-10-31T20:35:19.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54722024-10-31T20:35:19.247ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
54732024-10-31T20:35:19.247ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "0d81dc34-6d71-4bc1-b0d1-6f455de8ee09", "content-length": "2", "date": "Thu, 31 Oct 2024 20:35:19 GMT"} })
54742024-10-31T20:35:19.247ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
54752024-10-31T20:35:19.248ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "e305f529-ba5d-40f7-afba-7553e28787a6", "content-length": "52", "date": "Thu, 31 Oct 2024 20:35:19 GMT"} })
54762024-10-31T20:35:19.248ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 switch_location = Switch0
54772024-10-31T20:35:19.248ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
54782024-10-31T20:35:19.270ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54792024-10-31T20:35:19.272ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
54802024-10-31T20:35:19.272ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54812024-10-31T20:35:19.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54822024-10-31T20:35:19.368ZDEBGnexus (BackgroundTasks): client request SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
54832024-10-31T20:35:19.373ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "1f957b8b-45f6-4a8e-bd11-198ef9f05a48", "date": "Thu, 31 Oct 2024 20:35:19 GMT"} })
54842024-10-31T20:35:19.373ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 switch = Switch0
54852024-10-31T20:35:19.373ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
54862024-10-31T20:35:19.373ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "33731aa7-58a6-4d4f-8589-75e28f858bff", "content-length": "669", "date": "Thu, 31 Oct 2024 20:35:19 GMT"} })
54872024-10-31T20:35:19.373ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54882024-10-31T20:35:19.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54892024-10-31T20:35:19.374ZDEBGnexus (BackgroundTasks): client response SledAgent = 622abb78-eb68-41c1-ac52-e7a263024e57 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "43db98df-898e-4768-9cf0-646ac0986c0a", "content-length": "691", "date": "Thu, 31 Oct 2024 20:35:19 GMT"} })
54902024-10-31T20:35:19.374ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
54912024-10-31T20:35:19.374ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
54922024-10-31T20:35:19.374ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
54932024-10-31T20:35:19.375ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 733.179915ms iteration = 30 status = {}
54942024-10-31T20:35:19.377ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54952024-10-31T20:35:19.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54962024-10-31T20:35:19.381ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54972024-10-31T20:35:19.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54982024-10-31T20:35:19.384ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54992024-10-31T20:35:19.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55002024-10-31T20:35:19.391ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 748.990503ms iteration = 29 status = {}
55012024-10-31T20:35:20.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = c61e871c-0f86-490c-b713-5c673b6f311d roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
55022024-10-31T20:35:20.155ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = c61e871c-0f86-490c-b713-5c673b6f311d resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
55032024-10-31T20:35:20.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2405 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = c61e871c-0f86-490c-b713-5c673b6f311d response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
55042024-10-31T20:35:21.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 0ff2fc0b-a346-4820-8fa1-6c26e595ad66 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
55052024-10-31T20:35:21.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 0ff2fc0b-a346-4820-8fa1-6c26e595ad66 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
55062024-10-31T20:35:21.181ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2329 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 0ff2fc0b-a346-4820-8fa1-6c26e595ad66 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
55072024-10-31T20:35:22.204ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = b5520703-ea3d-40a8-8ea8-706f87b8f4e6 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
55082024-10-31T20:35:22.204ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = b5520703-ea3d-40a8-8ea8-706f87b8f4e6 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
55092024-10-31T20:35:22.206ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2780 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = b5520703-ea3d-40a8-8ea8-706f87b8f4e6 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
55102024-10-31T20:35:22.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = 0df739c4-d853-482b-b678-a0c9905de810 roles = RoleSet { roles: {} } uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?sort_by=id_ascending
55112024-10-31T20:35:22.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = 0df739c4-d853-482b-b678-a0c9905de810 resource = Database result = Ok(()) uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?sort_by=id_ascending
55122024-10-31T20:35:22.820ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2679 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = 0df739c4-d853-482b-b678-a0c9905de810 response_code = 200 uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?sort_by=id_ascending
55132024-10-31T20:35:22.820ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = 36eb4c22-a50e-4fc9-90df-0ada3c579ff5 roles = RoleSet { roles: {} } uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzA4NDI3Ny1iNmFhLTQ1OWYtOGY4MS1mNGVmNGM3Yzg0M2UifX0%3D
55142024-10-31T20:35:22.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = 36eb4c22-a50e-4fc9-90df-0ada3c579ff5 resource = Database result = Ok(()) uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzA4NDI3Ny1iNmFhLTQ1OWYtOGY4MS1mNGVmNGM3Yzg0M2UifX0%3D
55152024-10-31T20:35:22.823ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2433 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41912 req_id = 36eb4c22-a50e-4fc9-90df-0ada3c579ff5 response_code = 200 uri = /metrics/collectors/6e71f19b-440f-4a40-bbbb-fa1de5a7e58c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNzA4NDI3Ny1iNmFhLTQ1OWYtOGY4MS1mNGVmNGM3Yzg0M2UifX0%3D
55162024-10-31T20:35:23.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = e3dff691-1419-4362-8966-74e10553ea15 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
55172024-10-31T20:35:23.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = e3dff691-1419-4362-8966-74e10553ea15 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
55182024-10-31T20:35:23.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2315 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = e3dff691-1419-4362-8966-74e10553ea15 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
55192024-10-31T20:35:24.254ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = b91f2e58-fd85-4814-8f2b-b00dad5af928 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
55202024-10-31T20:35:24.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = b91f2e58-fd85-4814-8f2b-b00dad5af928 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
55212024-10-31T20:35:24.256ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2695 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = b91f2e58-fd85-4814-8f2b-b00dad5af928 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
55222024-10-31T20:35:25.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = c7e47c34-1f18-4c35-9f77-ecd12cb0cb03 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
55232024-10-31T20:35:25.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = c7e47c34-1f18-4c35-9f77-ecd12cb0cb03 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
55242024-10-31T20:35:25.280ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2255 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = c7e47c34-1f18-4c35-9f77-ecd12cb0cb03 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
55252024-10-31T20:35:26.300ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 12bd6cb8-f4eb-4895-a184-3c17a78ecfc8 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
55262024-10-31T20:35:26.300ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 12bd6cb8-f4eb-4895-a184-3c17a78ecfc8 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
55272024-10-31T20:35:26.302ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2012 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 12bd6cb8-f4eb-4895-a184-3c17a78ecfc8 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
55282024-10-31T20:35:27.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 49157359-77f0-40c3-a1b6-eaaf240a0f34 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
55292024-10-31T20:35:27.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 49157359-77f0-40c3-a1b6-eaaf240a0f34 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
55302024-10-31T20:35:27.327ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2564 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 49157359-77f0-40c3-a1b6-eaaf240a0f34 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
55312024-10-31T20:35:28.347ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 9025ce35-bfad-4f0d-a5b8-112cd2931b78 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
55322024-10-31T20:35:28.348ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 9025ce35-bfad-4f0d-a5b8-112cd2931b78 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
55332024-10-31T20:35:28.349ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2287 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 9025ce35-bfad-4f0d-a5b8-112cd2931b78 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
55342024-10-31T20:35:28.643ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 86 reason = Timeout
55352024-10-31T20:35:28.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55362024-10-31T20:35:28.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55372024-10-31T20:35:28.643ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 86 reason = Timeout
55382024-10-31T20:35:28.643ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55392024-10-31T20:35:28.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55402024-10-31T20:35:28.645ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55412024-10-31T20:35:28.648ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
55422024-10-31T20:35:28.648ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55432024-10-31T20:35:28.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55442024-10-31T20:35:28.650ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55452024-10-31T20:35:28.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55462024-10-31T20:35:28.652ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55472024-10-31T20:35:28.655ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 56b527e7-66b3-4602-a305-5dc763e7fb8b, lookup_type: ById(56b527e7-66b3-4602-a305-5dc763e7fb8b) } result = Ok(())
55482024-10-31T20:35:28.655ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55492024-10-31T20:35:28.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55502024-10-31T20:35:28.666ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b original_time_created = 2024-10-31 20:20:56.758465 UTC target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b time_created = 2024-10-31 20:20:56.758465 UTC
55512024-10-31T20:35:28.666ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.841148ms iteration = 86 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"56b527e7-66b3-4602-a305-5dc763e7fb8b","time_created":"2024-10-31T20:20:56.758465Z"}
55522024-10-31T20:35:28.673ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55532024-10-31T20:35:28.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55542024-10-31T20:35:28.701ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.687462ms iteration = 86 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
55552024-10-31T20:35:29.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 59e8e127-ffac-4407-89e1-cbddfa8bece0 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
55562024-10-31T20:35:29.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 59e8e127-ffac-4407-89e1-cbddfa8bece0 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
55572024-10-31T20:35:29.374ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2103 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 59e8e127-ffac-4407-89e1-cbddfa8bece0 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
55582024-10-31T20:35:30.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 38b7cc18-2e10-4ac5-893f-ca992cff982c roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
55592024-10-31T20:35:30.395ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 38b7cc18-2e10-4ac5-893f-ca992cff982c resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
55602024-10-31T20:35:30.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2098 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 38b7cc18-2e10-4ac5-893f-ca992cff982c response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
55612024-10-31T20:35:31.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 9089a41c-d925-4f50-b171-bf6d8b82ede0 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
55622024-10-31T20:35:31.419ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 9089a41c-d925-4f50-b171-bf6d8b82ede0 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
55632024-10-31T20:35:31.420ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2222 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 9089a41c-d925-4f50-b171-bf6d8b82ede0 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
55642024-10-31T20:35:32.442ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 1575355f-a625-4d5f-bd2c-4406ab828189 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
55652024-10-31T20:35:32.443ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 1575355f-a625-4d5f-bd2c-4406ab828189 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
55662024-10-31T20:35:32.444ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2261 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 1575355f-a625-4d5f-bd2c-4406ab828189 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
55672024-10-31T20:35:32.826ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1735 local_addr = [fd00:1122:3344:101::c]:63183 method = GET remote_addr = [fd00:1122:3344:101::d]:38560 req_id = fea7b171-ccc6-45a6-960f-b6bf3be244d9 response_code = 200 uri = /d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
55682024-10-31T20:35:33.469ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = ba791983-2086-4b7f-82e3-4cd640fbf05a roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
55692024-10-31T20:35:33.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = ba791983-2086-4b7f-82e3-4cd640fbf05a resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
55702024-10-31T20:35:33.471ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2340 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = ba791983-2086-4b7f-82e3-4cd640fbf05a response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
55712024-10-31T20:35:34.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = a2d9e942-c16a-4364-ae81-7c3d172a7064 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
55722024-10-31T20:35:34.494ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = a2d9e942-c16a-4364-ae81-7c3d172a7064 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
55732024-10-31T20:35:34.496ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2718 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = a2d9e942-c16a-4364-ae81-7c3d172a7064 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
55742024-10-31T20:35:35.519ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = ced92cc8-ca31-42c9-bc4b-52be6086aed7 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
55752024-10-31T20:35:35.519ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = ced92cc8-ca31-42c9-bc4b-52be6086aed7 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
55762024-10-31T20:35:35.521ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2418 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = ced92cc8-ca31-42c9-bc4b-52be6086aed7 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
55772024-10-31T20:35:36.544ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 0ffc7fd1-66b9-4994-897e-858899a36a5d roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
55782024-10-31T20:35:36.545ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 0ffc7fd1-66b9-4994-897e-858899a36a5d resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
55792024-10-31T20:35:36.547ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3010 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 0ffc7fd1-66b9-4994-897e-858899a36a5d response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
55802024-10-31T20:35:37.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 95584eed-7c39-4886-a2e1-0eb5443a2810 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
55812024-10-31T20:35:37.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 95584eed-7c39-4886-a2e1-0eb5443a2810 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
55822024-10-31T20:35:37.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2233 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 95584eed-7c39-4886-a2e1-0eb5443a2810 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
55832024-10-31T20:35:38.591ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = c00c6916-0a0b-4b9a-9fe9-009beff22f5e roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
55842024-10-31T20:35:38.591ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = c00c6916-0a0b-4b9a-9fe9-009beff22f5e resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
55852024-10-31T20:35:38.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2147 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = c00c6916-0a0b-4b9a-9fe9-009beff22f5e response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
55862024-10-31T20:35:38.642ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 87 reason = Timeout
55872024-10-31T20:35:38.642ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55882024-10-31T20:35:38.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55892024-10-31T20:35:38.644ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 87 reason = Timeout
55902024-10-31T20:35:38.644ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55912024-10-31T20:35:38.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55922024-10-31T20:35:38.646ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55932024-10-31T20:35:38.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55942024-10-31T20:35:38.650ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 6.351682ms iteration = 87 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
55952024-10-31T20:35:38.680ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55962024-10-31T20:35:38.683ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
55972024-10-31T20:35:38.683ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55982024-10-31T20:35:38.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55992024-10-31T20:35:38.685ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56002024-10-31T20:35:38.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56012024-10-31T20:35:38.687ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56022024-10-31T20:35:38.689ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 56b527e7-66b3-4602-a305-5dc763e7fb8b, lookup_type: ById(56b527e7-66b3-4602-a305-5dc763e7fb8b) } result = Ok(())
56032024-10-31T20:35:38.689ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56042024-10-31T20:35:38.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56052024-10-31T20:35:38.700ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b original_time_created = 2024-10-31 20:20:56.758465 UTC target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b time_created = 2024-10-31 20:20:56.758465 UTC
56062024-10-31T20:35:38.700ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 57.53635ms iteration = 87 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"56b527e7-66b3-4602-a305-5dc763e7fb8b","time_created":"2024-10-31T20:20:56.758465Z"}
56072024-10-31T20:35:39.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 729e6e1d-1265-44b8-aab0-9ef95d77d873 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
56082024-10-31T20:35:39.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 729e6e1d-1265-44b8-aab0-9ef95d77d873 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
56092024-10-31T20:35:39.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1899 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 729e6e1d-1265-44b8-aab0-9ef95d77d873 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
56102024-10-31T20:35:40.641ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = a1200c45-861a-4f10-8c08-73f9681498b6 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
56112024-10-31T20:35:40.641ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = a1200c45-861a-4f10-8c08-73f9681498b6 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
56122024-10-31T20:35:40.643ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2547 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = a1200c45-861a-4f10-8c08-73f9681498b6 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
56132024-10-31T20:35:41.665ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = d961570a-9cda-44b4-b021-47ece02b4fde roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
56142024-10-31T20:35:41.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = d961570a-9cda-44b4-b021-47ece02b4fde resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
56152024-10-31T20:35:41.667ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2097 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = d961570a-9cda-44b4-b021-47ece02b4fde response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
56162024-10-31T20:35:42.689ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = cb1bd145-28f7-4702-b0f8-7f849ce59c91 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
56172024-10-31T20:35:42.689ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = cb1bd145-28f7-4702-b0f8-7f849ce59c91 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
56182024-10-31T20:35:42.691ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2370 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = cb1bd145-28f7-4702-b0f8-7f849ce59c91 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
56192024-10-31T20:35:43.714ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 00bc74d7-b2aa-4862-8e25-d083a48684a9 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
56202024-10-31T20:35:43.714ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 00bc74d7-b2aa-4862-8e25-d083a48684a9 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
56212024-10-31T20:35:43.716ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2777 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 00bc74d7-b2aa-4862-8e25-d083a48684a9 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
56222024-10-31T20:35:44.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46541 req_id = 269cb345-a9d1-47f3-b36c-f0175f11a6c4 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
56232024-10-31T20:35:44.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46541 req_id = 269cb345-a9d1-47f3-b36c-f0175f11a6c4 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
56242024-10-31T20:35:44.411ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3720 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46541 req_id = 269cb345-a9d1-47f3-b36c-f0175f11a6c4 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
56252024-10-31T20:35:44.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 6a666739-02b4-4809-b31c-cc9cbaf82d65 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
56262024-10-31T20:35:44.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 6a666739-02b4-4809-b31c-cc9cbaf82d65 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
56272024-10-31T20:35:44.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2466 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 6a666739-02b4-4809-b31c-cc9cbaf82d65 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
56282024-10-31T20:35:45.765ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 7e4d73a8-1d5b-440d-af9e-1488cf00f65b roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
56292024-10-31T20:35:45.765ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 7e4d73a8-1d5b-440d-af9e-1488cf00f65b resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
56302024-10-31T20:35:45.767ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2661 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 7e4d73a8-1d5b-440d-af9e-1488cf00f65b response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
56312024-10-31T20:35:46.789ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 29bab062-6930-458f-a309-d5f694d14f2a roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
56322024-10-31T20:35:46.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 29bab062-6930-458f-a309-d5f694d14f2a resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
56332024-10-31T20:35:46.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2622 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 29bab062-6930-458f-a309-d5f694d14f2a response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
56342024-10-31T20:35:47.814ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 2ebcb129-d004-48eb-9ddb-ab1e04111513 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
56352024-10-31T20:35:47.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 2ebcb129-d004-48eb-9ddb-ab1e04111513 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
56362024-10-31T20:35:47.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2293 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 2ebcb129-d004-48eb-9ddb-ab1e04111513 response_code = 200 uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
56372024-10-31T20:35:47.826ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1270 local_addr = [fd00:1122:3344:101::c]:63183 method = GET remote_addr = [fd00:1122:3344:101::d]:38560 req_id = 7b21746b-a690-4053-bd0b-8383aebe072b response_code = 200 uri = /d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
56382024-10-31T20:35:48.643ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 88 reason = Timeout
56392024-10-31T20:35:48.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56402024-10-31T20:35:48.643ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 31 reason = Timeout
56412024-10-31T20:35:48.643ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 34 reason = Timeout
56422024-10-31T20:35:48.643ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56432024-10-31T20:35:48.643ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
56442024-10-31T20:35:48.643ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 30 reason = Timeout
56452024-10-31T20:35:48.643ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 30 reason = Timeout
56462024-10-31T20:35:48.643ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56472024-10-31T20:35:48.643ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 30 reason = Timeout
56482024-10-31T20:35:48.643ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
56492024-10-31T20:35:48.643ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 30 reason = Timeout
56502024-10-31T20:35:48.643ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 30 reason = Timeout
56512024-10-31T20:35:48.643ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
56522024-10-31T20:35:48.643ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 30 reason = Timeout
56532024-10-31T20:35:48.643ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56542024-10-31T20:35:48.643ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
56552024-10-31T20:35:48.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
56562024-10-31T20:35:48.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
56572024-10-31T20:35:48.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56582024-10-31T20:35:48.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56592024-10-31T20:35:48.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56602024-10-31T20:35:48.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56612024-10-31T20:35:48.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
56622024-10-31T20:35:48.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
56632024-10-31T20:35:48.644ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 32 reason = Timeout
56642024-10-31T20:35:48.644ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 30 reason = Timeout
56652024-10-31T20:35:48.644ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
56662024-10-31T20:35:48.644ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 30 reason = Timeout
56672024-10-31T20:35:48.644ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56682024-10-31T20:35:48.644ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 7.71\u{b5}s iteration = 30 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
56692024-10-31T20:35:48.644ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 30 reason = Timeout
56702024-10-31T20:35:48.644ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 30 reason = Timeout
56712024-10-31T20:35:48.644ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
56722024-10-31T20:35:48.644ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 6.14\u{b5}s iteration = 30 status = {"errors":[],"garbage_collect_requested":[]}
56732024-10-31T20:35:48.644ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 3.53\u{b5}s iteration = 30 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
56742024-10-31T20:35:48.644ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 30 reason = Timeout
56752024-10-31T20:35:48.644ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 88 reason = Timeout
56762024-10-31T20:35:48.644ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 30 reason = Timeout
56772024-10-31T20:35:48.644ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 2.93\u{b5}s iteration = 30 status = {"errors":[],"records_set_to_done":[]}
56782024-10-31T20:35:48.644ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
56792024-10-31T20:35:48.644ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56802024-10-31T20:35:48.644ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
56812024-10-31T20:35:48.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56822024-10-31T20:35:48.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56832024-10-31T20:35:48.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
56842024-10-31T20:35:48.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
56852024-10-31T20:35:48.645ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56862024-10-31T20:35:48.646ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56872024-10-31T20:35:48.646ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.109104ms iteration = 30 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
56882024-10-31T20:35:48.647ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1861, tv_nsec: 301666214 } })
56892024-10-31T20:35:48.647ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56902024-10-31T20:35:48.647ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
56912024-10-31T20:35:48.648ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
56922024-10-31T20:35:48.648ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
56932024-10-31T20:35:48.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
56942024-10-31T20:35:48.649ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56952024-10-31T20:35:48.649ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56962024-10-31T20:35:48.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56972024-10-31T20:35:48.649ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
56982024-10-31T20:35:48.649ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56992024-10-31T20:35:48.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57002024-10-31T20:35:48.651ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1861, tv_nsec: 306530209 } })
57012024-10-31T20:35:48.652ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
57022024-10-31T20:35:48.652ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57032024-10-31T20:35:48.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57042024-10-31T20:35:48.653ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57052024-10-31T20:35:48.656ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
57062024-10-31T20:35:48.656ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
57072024-10-31T20:35:48.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
57082024-10-31T20:35:48.657ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57092024-10-31T20:35:48.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57102024-10-31T20:35:48.658ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57112024-10-31T20:35:48.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57122024-10-31T20:35:48.659ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 14.745379ms iteration = 88 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57132024-10-31T20:35:48.660ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-622abb78-eb68-41c1-ac52-e7a263024e57.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1861, tv_nsec: 315065219 } })
57142024-10-31T20:35:48.660ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439
57152024-10-31T20:35:48.662ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57162024-10-31T20:35:48.664ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
57172024-10-31T20:35:48.664ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57182024-10-31T20:35:48.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57192024-10-31T20:35:48.686ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
57202024-10-31T20:35:48.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
57212024-10-31T20:35:48.687ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57222024-10-31T20:35:48.688ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 45.02148ms iteration = 30 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
57232024-10-31T20:35:48.688ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
57242024-10-31T20:35:48.688ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
57252024-10-31T20:35:48.688ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
57262024-10-31T20:35:48.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
57272024-10-31T20:35:48.689ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
57282024-10-31T20:35:48.689ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57292024-10-31T20:35:48.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57302024-10-31T20:35:48.690ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57312024-10-31T20:35:48.690ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57322024-10-31T20:35:48.691ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57332024-10-31T20:35:48.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57342024-10-31T20:35:48.693ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
57352024-10-31T20:35:48.693ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57362024-10-31T20:35:48.693ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
57372024-10-31T20:35:48.693ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
57382024-10-31T20:35:48.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57392024-10-31T20:35:48.693ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "affe1d68-cd2c-49b9-a9a6-619fc319a3fa", "content-length": "26", "date": "Thu, 31 Oct 2024 20:35:47 GMT"} })
57402024-10-31T20:35:48.693ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
57412024-10-31T20:35:48.694ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
57422024-10-31T20:35:48.694ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
57432024-10-31T20:35:48.694ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 50.418845ms iteration = 30 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
57442024-10-31T20:35:48.694ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57452024-10-31T20:35:48.695ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 56b527e7-66b3-4602-a305-5dc763e7fb8b, lookup_type: ById(56b527e7-66b3-4602-a305-5dc763e7fb8b) } result = Ok(())
57462024-10-31T20:35:48.695ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57472024-10-31T20:35:48.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57482024-10-31T20:35:48.697ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
57492024-10-31T20:35:48.697ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57502024-10-31T20:35:48.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57512024-10-31T20:35:48.701ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
57522024-10-31T20:35:48.701ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
57532024-10-31T20:35:48.701ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c299e80-2dce-4e0b-8253-15aa1fc0a9d9", "content-length": "26", "date": "Thu, 31 Oct 2024 20:35:47 GMT"} })
57542024-10-31T20:35:48.701ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
57552024-10-31T20:35:48.702ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
57562024-10-31T20:35:48.707ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b original_time_created = 2024-10-31 20:20:56.758465 UTC target_id = 56b527e7-66b3-4602-a305-5dc763e7fb8b time_created = 2024-10-31 20:20:56.758465 UTC
57572024-10-31T20:35:48.707ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 64.095014ms iteration = 88 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"56b527e7-66b3-4602-a305-5dc763e7fb8b","time_created":"2024-10-31T20:20:56.758465Z"}
57582024-10-31T20:35:48.716ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 zone_address = fd00:1122:3344:101::2
57592024-10-31T20:35:48.716ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
57602024-10-31T20:35:48.716ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9c62d6c7-5c6a-41e6-be39-444813d19221", "content-length": "26", "date": "Thu, 31 Oct 2024 20:35:47 GMT"} })
57612024-10-31T20:35:48.716ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
57622024-10-31T20:35:48.718ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cf9a2d24-88ed-47a2-a402-0cbbba2d1439
57632024-10-31T20:35:48.720ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57642024-10-31T20:35:48.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57652024-10-31T20:35:48.722ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57662024-10-31T20:35:48.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57672024-10-31T20:35:48.725ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
57682024-10-31T20:35:48.725ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
57692024-10-31T20:35:48.725ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
57702024-10-31T20:35:48.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
57712024-10-31T20:35:48.754ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57722024-10-31T20:35:48.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57732024-10-31T20:35:48.757ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 114.377727ms iteration = 34 status = {"physical_disks_added":0}
57742024-10-31T20:35:48.803ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
57752024-10-31T20:35:48.803ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "55f8fac6-a603-42fd-96c9-db1e52b0c723", "content-length": "2", "date": "Thu, 31 Oct 2024 20:35:48 GMT"} })
57762024-10-31T20:35:48.804ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
57772024-10-31T20:35:48.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
57782024-10-31T20:35:48.840ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 52951a15-d19e-41ca-b5a0-e48e6dc0ab61 roles = RoleSet { roles: {} } uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57
57792024-10-31T20:35:48.840ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42412 req_id = 52951a15-d19e-41ca-b5a0-e48e6dc0ab61 resource = Database result = Ok(()) uri = /probes/622abb78-eb68-41c1-ac52-e7a263024e57